Jul 24 14:48:07 user nova-compute[70645]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 24 14:48:09 user nova-compute[70645]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=70645) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 24 14:48:09 user nova-compute[70645]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=70645) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 24 14:48:09 user nova-compute[70645]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=70645) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 24 14:48:09 user nova-compute[70645]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 24 14:48:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:48:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:48:09 user nova-compute[70645]: INFO nova.virt.driver [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 24 14:48:10 user nova-compute[70645]: INFO nova.compute.provider_config [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] Acquiring lock "singleton_lock" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] Acquired lock "singleton_lock" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] Releasing lock "singleton_lock" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] Full set of CONF: {{(pid=70645) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ******************************************************************************** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] Configuration options gathered from: {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ================================================================================ {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] allow_resize_to_same_host      = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] arq_binding_timeout            = 300 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] backdoor_port                  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] backdoor_socket                = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] block_device_allocate_retries  = 300 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] block_device_allocate_retries_interval = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cert                           = self.pem {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute_monitors               = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] config_dir                     = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] config_drive_format            = iso9660 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] config_source                  = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] console_host                   = user {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] control_exchange               = nova {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cpu_allocation_ratio           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] daemon                         = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] debug                          = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] default_access_ip_network_name = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] default_availability_zone      = nova {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] default_ephemeral_format       = ext4 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] default_schedule_zone          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] disk_allocation_ratio          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] enable_new_services            = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] enabled_apis                   = ['osapi_compute'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] enabled_ssl_apis               = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] flat_injected                  = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] force_config_drive             = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] force_raw_images               = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] graceful_shutdown_timeout      = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] heal_instance_info_cache_interval = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] host                           = user {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] instance_build_timeout         = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] instance_delete_interval       = 300 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] instance_name_template         = instance-%08x {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] instance_usage_audit           = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] instance_usage_audit_period    = month {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] internal_service_availability_zone = internal {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] key                            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] live_migration_retry_count     = 30 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] log_config_append              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] log_dir                        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] log_file                       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] log_options                    = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] log_rotate_interval            = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] log_rotate_interval_type       = days {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] log_rotation_type              = none {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] long_rpc_timeout               = 1800 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] max_concurrent_builds          = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] max_concurrent_live_migrations = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] max_concurrent_snapshots       = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] max_local_block_devices        = 3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] max_logfile_count              = 30 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] max_logfile_size_mb            = 200 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] maximum_instance_delete_attempts = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] metadata_listen                = 0.0.0.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] metadata_listen_port           = 8775 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] metadata_workers               = 3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] migrate_max_retries            = -1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] mkisofs_cmd                    = genisoimage {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] my_ip                          = 10.0.0.210 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] network_allocate_retries       = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] osapi_compute_listen_port      = 8774 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] osapi_compute_unique_server_name_scope =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] osapi_compute_workers          = 3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] password_length                = 12 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] periodic_enable                = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] periodic_fuzzy_delay           = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] pointer_model                  = ps2mouse {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] preallocate_images             = none {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] publish_errors                 = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] pybasedir                      = /opt/stack/nova {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ram_allocation_ratio           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] rate_limit_burst               = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] rate_limit_except_level        = CRITICAL {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] rate_limit_interval            = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] reboot_timeout                 = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] reclaim_instance_interval      = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] record                         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] reimage_timeout_per_gb         = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] report_interval                = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] rescue_timeout                 = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] reserved_host_cpus             = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] reserved_host_disk_mb          = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] reserved_host_memory_mb        = 512 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] reserved_huge_pages            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] resize_confirm_window          = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] resize_fs_using_block_device   = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] resume_guests_state_on_host_boot = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] rpc_response_timeout           = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] run_external_periodic_tasks    = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] running_deleted_instance_action = reap {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] running_deleted_instance_poll_interval = 1800 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] running_deleted_instance_timeout = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler_instance_sync_interval = 120 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] service_down_time              = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] servicegroup_driver            = db {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] shelved_offload_time           = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] shelved_poll_interval          = 3600 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] shutdown_timeout               = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] source_is_ipv6                 = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ssl_only                       = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] state_path                     = /opt/stack/data/nova {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] sync_power_state_interval      = 600 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] sync_power_state_pool_size     = 1000 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] syslog_log_facility            = LOG_USER {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] tempdir                        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] timeout_nbd                    = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] transport_url                  = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] update_resources_interval      = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] use_cow_images                 = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] use_eventlog                   = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] use_journal                    = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] use_json                       = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] use_rootwrap_daemon            = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] use_stderr                     = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] use_syslog                     = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vcpu_pin_set                   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plugging_is_fatal          = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plugging_timeout           = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] virt_mkfs                      = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] volume_usage_poll_interval     = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] watch_log_file                 = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] web                            = /usr/share/spice-html5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_concurrency.disable_process_locking = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.auth_strategy              = keystone {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.compute_link_prefix        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.dhcp_domain                = novalocal {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.enable_instance_password   = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.glance_link_prefix         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.instance_list_per_project_cells = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.list_records_by_skipping_down_cells = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.local_metadata_per_cell    = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.max_limit                  = 1000 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.metadata_cache_expiration  = 15 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.neutron_default_tenant_id  = default {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.use_forwarded_for          = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.use_neutron_default_nets   = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.vendordata_dynamic_targets = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.vendordata_jsonfile_path   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.backend                  = dogpile.cache.memcached {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.backend_argument         = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.config_prefix            = cache.oslo {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.dead_timeout             = 60.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.debug_cache_backend      = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.enable_retry_client      = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.enable_socket_keepalive  = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.enabled                  = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.expiration_time          = 600 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.hashclient_retry_attempts = 2 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.memcache_dead_retry      = 300 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.memcache_password        =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.memcache_sasl_enabled    = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.memcache_username        =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.proxies                  = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.retry_attempts           = 2 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.retry_delay              = 0.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.socket_keepalive_count   = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.socket_keepalive_idle    = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.socket_keepalive_interval = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.tls_allowed_ciphers      = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.tls_cafile               = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.tls_certfile             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.tls_enabled              = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cache.tls_keyfile              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.auth_section            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.auth_type               = password {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.cafile                  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.certfile                = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.collect_timing          = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.cross_az_attach         = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.debug                   = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.endpoint_template       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.http_retries            = 3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.insecure                = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.keyfile                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.os_region_name          = RegionOne {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.split_loggers           = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cinder.timeout                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.cpu_dedicated_set      = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.cpu_shared_set         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.image_type_exclude_list = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.max_concurrent_disk_ops = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.max_disk_devices_to_attach = -1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.resource_provider_association_refresh = 300 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.shutdown_retry_interval = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] conductor.workers              = 3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] console.allowed_origins        = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] console.ssl_ciphers            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] console.ssl_minimum_version    = default {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] consoleauth.token_ttl          = 600 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.cafile                  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.certfile                = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.collect_timing          = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.connect_retries         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.connect_retry_delay     = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.endpoint_override       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.insecure                = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.keyfile                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.max_version             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.min_version             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.region_name             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.service_name            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.service_type            = accelerator {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.split_loggers           = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.status_code_retries     = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.status_code_retry_delay = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.timeout                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] cyborg.version                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.backend               = sqlalchemy {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.connection            = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.connection_debug      = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.connection_parameters =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.connection_recycle_time = 3600 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.connection_trace      = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.db_inc_retry_interval = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.db_max_retries        = 20 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.db_max_retry_interval = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.db_retry_interval     = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.max_overflow          = 50 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.max_pool_size         = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.max_retries           = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.mysql_enable_ndb      = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.mysql_wsrep_sync_wait = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.pool_timeout          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.retry_interval        = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.slave_connection      = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] database.sqlite_synchronous    = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.backend           = sqlalchemy {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.connection        = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.connection_debug  = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.connection_parameters =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.connection_recycle_time = 3600 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.connection_trace  = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.db_inc_retry_interval = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.db_max_retries    = 20 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.db_max_retry_interval = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.db_retry_interval = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.max_overflow      = 50 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.max_pool_size     = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.max_retries       = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.mysql_enable_ndb  = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.pool_timeout      = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.retry_interval    = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.slave_connection  = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] api_database.sqlite_synchronous = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] devices.enabled_mdev_types     = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ephemeral_storage_encryption.enabled = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.api_servers             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.cafile                  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.certfile                = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.collect_timing          = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.connect_retries         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.connect_retry_delay     = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.debug                   = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.default_trusted_certificate_ids = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.enable_certificate_validation = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.enable_rbd_download     = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.endpoint_override       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.insecure                = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.keyfile                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.max_version             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.min_version             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.num_retries             = 3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.rbd_ceph_conf           =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.rbd_connect_timeout     = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.rbd_pool                =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.rbd_user                =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.region_name             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.service_name            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.service_type            = image {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.split_loggers           = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.status_code_retries     = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.status_code_retry_delay = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.timeout                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.verify_glance_signatures = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] glance.version                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] guestfs.debug                  = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.config_drive_cdrom      = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.config_drive_inject_password = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.enable_instance_metrics_collection = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.enable_remotefx         = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.instances_path_share    =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.iscsi_initiator_list    = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.limit_cpu_features      = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.power_state_check_timeframe = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.use_multipath_io        = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.volume_attach_retry_count = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.vswitch_name            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] mks.enabled                    = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] image_cache.manager_interval   = 2400 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] image_cache.precache_concurrency = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] image_cache.remove_unused_base_images = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] image_cache.subdirectory_name  = _base {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.api_max_retries         = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.api_retry_interval      = 2 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.auth_section            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.auth_type               = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.cafile                  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.certfile                = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.collect_timing          = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.connect_retries         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.connect_retry_delay     = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.endpoint_override       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.insecure                = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.keyfile                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.max_version             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.min_version             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.partition_key           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.peer_list               = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.region_name             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.serial_console_state_timeout = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.service_name            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.service_type            = baremetal {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.split_loggers           = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.status_code_retries     = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.status_code_retry_delay = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.timeout                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ironic.version                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] key_manager.fixed_key          = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.barbican_api_version  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.barbican_endpoint     = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.barbican_endpoint_type = public {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.barbican_region_name  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.cafile                = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.certfile              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.collect_timing        = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.insecure              = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.keyfile               = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.number_of_retries     = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.retry_delay           = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.send_service_user_token = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.split_loggers         = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.timeout               = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.verify_ssl            = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican.verify_ssl_path       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican_service_user.auth_section = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican_service_user.auth_type = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican_service_user.cafile   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican_service_user.certfile = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican_service_user.collect_timing = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican_service_user.insecure = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican_service_user.keyfile  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican_service_user.split_loggers = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] barbican_service_user.timeout  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.approle_role_id          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.approle_secret_id        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.cafile                   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.certfile                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.collect_timing           = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.insecure                 = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.keyfile                  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.kv_mountpoint            = secret {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.kv_version               = 2 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.namespace                = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.root_token_id            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.split_loggers            = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.ssl_ca_crt_file          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.timeout                  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.use_ssl                  = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.cafile                = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.certfile              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.collect_timing        = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.connect_retries       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.connect_retry_delay   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.endpoint_override     = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.insecure              = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.keyfile               = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.max_version           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.min_version           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.region_name           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.service_name          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.service_type          = identity {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.split_loggers         = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.status_code_retries   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.status_code_retry_delay = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.timeout               = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] keystone.version               = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.connection_uri         =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.cpu_mode               = custom {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: WARNING oslo_config.cfg [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.cpu_power_governor_high = performance {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.cpu_power_governor_low = powersave {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.cpu_power_management   = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.device_detach_attempts = 8 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.device_detach_timeout  = 20 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.disk_cachemodes        = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.disk_prefix            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.enabled_perf_events    = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.file_backed_memory     = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.gid_maps               = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.hw_disk_discard        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.hw_machine_type        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.images_rbd_glance_store_name =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.images_rbd_pool        = rbd {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.images_type            = default {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.images_volume_group    = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.inject_key             = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.inject_partition       = -2 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.inject_password        = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.iscsi_iface            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.iser_use_multipath     = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_bandwidth = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_downtime = 500 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_inbound_addr = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_permit_post_copy = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_scheme  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_timeout_action = abort {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_tunnelled = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: WARNING oslo_config.cfg [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 24 14:48:10 user nova-compute[70645]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 24 14:48:10 user nova-compute[70645]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 24 14:48:10 user nova-compute[70645]: and ``live_migration_inbound_addr`` respectively.
Jul 24 14:48:10 user nova-compute[70645]: ).  Its value may be silently ignored in the future.
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.live_migration_with_native_tls = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.max_queues             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.nfs_mount_options      = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.num_memory_encrypted_guests = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.num_pcie_ports         = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.pmem_namespaces        = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.quobyte_client_cfg     = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.rbd_secret_uuid        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.rbd_user               = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.remote_filesystem_transport = ssh {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.rescue_image_id        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.rescue_kernel_id       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.rescue_ramdisk_id      = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.rx_queue_size          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.smbfs_mount_options    =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.snapshot_compression   = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.snapshot_image_format  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.sparse_logical_volumes = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.swtpm_enabled          = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.swtpm_group            = tss {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.swtpm_user             = tss {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.sysinfo_serial         = unique {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.tb_cache_size          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.tx_queue_size          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.uid_maps               = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.use_virtio_for_bridges = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.virt_type              = kvm {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.volume_clear           = zero {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.volume_clear_size      = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.volume_use_multipath   = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.vzstorage_cache_path   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.vzstorage_mount_user   = stack {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.auth_section           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.auth_type              = password {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.cafile                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.certfile               = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.collect_timing         = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.connect_retries        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.connect_retry_delay    = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.default_floating_pool  = public {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.endpoint_override      = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.extension_sync_interval = 600 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.http_retries           = 3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.insecure               = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.keyfile                = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.max_version            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.min_version            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.ovs_bridge             = br-int {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.physnets               = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.region_name            = RegionOne {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.service_metadata_proxy = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.service_name           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.service_type           = network {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.split_loggers          = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.status_code_retries    = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.status_code_retry_delay = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.timeout                = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] neutron.version                = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] notifications.bdms_in_notifications = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] notifications.default_level    = INFO {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] notifications.notification_format = unversioned {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] notifications.notify_on_state_change = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] pci.alias                      = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] pci.device_spec                = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] pci.report_in_placement        = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.auth_section         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.auth_type            = password {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.cafile               = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.certfile             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.collect_timing       = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.connect_retries      = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.connect_retry_delay  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.default_domain_id    = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.default_domain_name  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.domain_id            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.domain_name          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.endpoint_override    = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.insecure             = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.keyfile              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.max_version          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.min_version          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.password             = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.project_domain_id    = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.project_domain_name  = Default {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.project_id           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.project_name         = service {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.region_name          = RegionOne {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.service_name         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.service_type         = placement {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.split_loggers        = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.status_code_retries  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.status_code_retry_delay = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.system_scope         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.timeout              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.trust_id             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.user_domain_id       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.user_domain_name     = Default {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.user_id              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.username             = placement {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] placement.version              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.cores                    = 20 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.count_usage_from_placement = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.injected_file_content_bytes = 10240 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.injected_file_path_length = 255 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.injected_files           = 5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.instances                = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.key_pairs                = 100 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.metadata_items           = 128 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.ram                      = 51200 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.recheck_quota            = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.server_group_members     = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] quota.server_groups            = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] rdp.enabled                    = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler.image_metadata_prefilter = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler.max_attempts         = 3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler.max_placement_results = 1000 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler.query_placement_for_availability_zone = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler.query_placement_for_image_type_support = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] scheduler.workers              = 3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.host_subset_size = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.isolated_hosts = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.isolated_images = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.pci_in_placement = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.track_instance_changes = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] metrics.required               = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] metrics.weight_multiplier      = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] metrics.weight_setting         = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] serial_console.enabled         = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] serial_console.port_range      = 10000:20000 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] serial_console.serialproxy_port = 6083 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] service_user.auth_section      = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] service_user.auth_type         = password {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] service_user.cafile            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] service_user.certfile          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] service_user.collect_timing    = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] service_user.insecure          = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] service_user.keyfile           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] service_user.send_service_user_token = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] service_user.split_loggers     = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] service_user.timeout           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.agent_enabled            = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.enabled                  = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.html5proxy_port          = 6082 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.image_compression        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.jpeg_compression         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.playback_compression     = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.server_listen            = 127.0.0.1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.streaming_mode           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] spice.zlib_compression         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] upgrade_levels.baseapi         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] upgrade_levels.cert            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] upgrade_levels.compute         = auto {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] upgrade_levels.conductor       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] upgrade_levels.scheduler       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vendordata_dynamic_auth.auth_section = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vendordata_dynamic_auth.auth_type = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vendordata_dynamic_auth.cafile = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vendordata_dynamic_auth.certfile = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vendordata_dynamic_auth.insecure = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vendordata_dynamic_auth.keyfile = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vendordata_dynamic_auth.timeout = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.api_retry_count         = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.ca_file                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.cache_prefix            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.cluster_name            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.connection_pool_size    = 10 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.console_delay_seconds   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.datastore_regex         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.host_ip                 = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.host_password           = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.host_port               = 443 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.host_username           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.insecure                = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.integration_bridge      = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.maximum_objects         = 100 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.pbm_default_policy      = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.pbm_enabled             = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.pbm_wsdl_location       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.serial_port_proxy_uri   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.serial_port_service_uri = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.task_poll_interval      = 0.5 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.use_linked_clone        = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.vnc_keymap              = en-us {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.vnc_port                = 5900 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vmware.vnc_port_total          = 10000 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vnc.auth_schemes               = ['none'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vnc.enabled                    = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vnc.novncproxy_port            = 6080 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vnc.server_listen              = 0.0.0.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vnc.vencrypt_ca_certs          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vnc.vencrypt_client_cert       = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vnc.vencrypt_client_key        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.disable_rootwrap   = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.enable_numa_live_migration = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.libvirt_disable_apic = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] wsgi.client_socket_timeout     = 900 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] wsgi.default_pool_size         = 1000 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] wsgi.keep_alive                = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] wsgi.max_header_line           = 16384 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] wsgi.ssl_ca_file               = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] wsgi.ssl_cert_file             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] wsgi.ssl_key_file              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] wsgi.tcp_keepidle              = 600 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] zvm.ca_file                    = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] zvm.cloud_connector_url        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] zvm.reachable_timeout          = 300 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_policy.enforce_new_defaults = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_policy.enforce_scope      = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_policy.policy_default_rule = default {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler.connection_string     = messaging:// {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler.enabled               = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler.es_doc_type           = notification {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler.es_scroll_size        = 10000 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler.es_scroll_time        = 2m {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler.filter_error_trace    = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler.hmac_keys             = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler.sentinel_service_name = mymaster {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler.socket_timeout        = 0.1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler.trace_requests        = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler.trace_sqlalchemy      = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler_jaeger.process_tags   = {} {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler_jaeger.service_name_prefix = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] profiler_otlp.service_name_prefix = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] remote_debug.host              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] remote_debug.port              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_notifications.retry = -1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.auth_section        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.auth_type           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.cafile              = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.certfile            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.collect_timing      = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.connect_retries     = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.connect_retry_delay = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.endpoint_id         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.endpoint_override   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.insecure            = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.keyfile             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.max_version         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.min_version         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.region_name         = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.service_name        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.service_type        = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.split_loggers       = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.status_code_retries = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.status_code_retry_delay = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.timeout             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.valid_interfaces    = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_limit.version             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_reports.file_event_handler = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] oslo_reports.log_dir           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_ovs_privileged.group  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] vif_plug_ovs_privileged.user   = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_linux_bridge.flat_interface = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_ovs.isolate_vif         = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_vif_ovs.per_port_bridge     = False {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] os_brick.lock_path             = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] privsep_osbrick.capabilities   = [21] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] privsep_osbrick.group          = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] privsep_osbrick.helper_command = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] privsep_osbrick.user           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] nova_sys_admin.group           = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] nova_sys_admin.helper_command  = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] nova_sys_admin.user            = None {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG oslo_service.service [None req-060dd785-603c-451d-9aca-5be48a2bdfb2 None None] ******************************************************************************** {{(pid=70645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 24 14:48:10 user nova-compute[70645]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 24 14:48:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Starting native event thread {{(pid=70645) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Starting green dispatch thread {{(pid=70645) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Starting connection event dispatch thread {{(pid=70645) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Connecting to libvirt: qemu:///system {{(pid=70645) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fba9dcc33a0> {{(pid=70645) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 24 14:48:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fba9dcc33a0> {{(pid=70645) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 24 14:48:10 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Connection event '1' reason 'None'
Jul 24 14:48:10 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 24 14:48:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.mount [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Initialising _HostMountState generation 0 {{(pid=70645) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 24 14:48:17 user nova-compute[70645]: INFO nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Libvirt host capabilities <capabilities>
Jul 24 14:48:17 user nova-compute[70645]:   <host>
Jul 24 14:48:17 user nova-compute[70645]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 24 14:48:17 user nova-compute[70645]:     <cpu>
Jul 24 14:48:17 user nova-compute[70645]:       <arch>x86_64</arch>
Jul 24 14:48:17 user nova-compute[70645]:       <model>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <vendor>Intel</vendor>
Jul 24 14:48:17 user nova-compute[70645]:       <microcode version='1070'/>
Jul 24 14:48:17 user nova-compute[70645]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 24 14:48:17 user nova-compute[70645]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='ss'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='vmx'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='pcid'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='osxsave'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='hypervisor'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='arat'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='tsc_adjust'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='md-clear'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='arch-capabilities'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='invtsc'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='rsba'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature name='skip-l1dfl-vmentry'/>
Jul 24 14:48:17 user nova-compute[70645]:       <pages unit='KiB' size='4'/>
Jul 24 14:48:17 user nova-compute[70645]:       <pages unit='KiB' size='2048'/>
Jul 24 14:48:17 user nova-compute[70645]:     </cpu>
Jul 24 14:48:17 user nova-compute[70645]:     <power_management>
Jul 24 14:48:17 user nova-compute[70645]:       <suspend_mem/>
Jul 24 14:48:17 user nova-compute[70645]:       <suspend_disk/>
Jul 24 14:48:17 user nova-compute[70645]:       <suspend_hybrid/>
Jul 24 14:48:17 user nova-compute[70645]:     </power_management>
Jul 24 14:48:17 user nova-compute[70645]:     <iommu support='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     <migration_features>
Jul 24 14:48:17 user nova-compute[70645]:       <live/>
Jul 24 14:48:17 user nova-compute[70645]:       <uri_transports>
Jul 24 14:48:17 user nova-compute[70645]:         <uri_transport>tcp</uri_transport>
Jul 24 14:48:17 user nova-compute[70645]:         <uri_transport>rdma</uri_transport>
Jul 24 14:48:17 user nova-compute[70645]:       </uri_transports>
Jul 24 14:48:17 user nova-compute[70645]:     </migration_features>
Jul 24 14:48:17 user nova-compute[70645]:     <topology>
Jul 24 14:48:17 user nova-compute[70645]:       <cells num='2'>
Jul 24 14:48:17 user nova-compute[70645]:         <cell id='0'>
Jul 24 14:48:17 user nova-compute[70645]:           <memory unit='KiB'>8140616</memory>
Jul 24 14:48:17 user nova-compute[70645]:           <pages unit='KiB' size='4'>2035154</pages>
Jul 24 14:48:17 user nova-compute[70645]:           <pages unit='KiB' size='2048'>0</pages>
Jul 24 14:48:17 user nova-compute[70645]:           <distances>
Jul 24 14:48:17 user nova-compute[70645]:             <sibling id='0' value='10'/>
Jul 24 14:48:17 user nova-compute[70645]:             <sibling id='1' value='20'/>
Jul 24 14:48:17 user nova-compute[70645]:           </distances>
Jul 24 14:48:17 user nova-compute[70645]:           <cpus num='6'>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 24 14:48:17 user nova-compute[70645]:           </cpus>
Jul 24 14:48:17 user nova-compute[70645]:         </cell>
Jul 24 14:48:17 user nova-compute[70645]:         <cell id='1'>
Jul 24 14:48:17 user nova-compute[70645]:           <memory unit='KiB'>8255100</memory>
Jul 24 14:48:17 user nova-compute[70645]:           <pages unit='KiB' size='4'>2063775</pages>
Jul 24 14:48:17 user nova-compute[70645]:           <pages unit='KiB' size='2048'>0</pages>
Jul 24 14:48:17 user nova-compute[70645]:           <distances>
Jul 24 14:48:17 user nova-compute[70645]:             <sibling id='0' value='20'/>
Jul 24 14:48:17 user nova-compute[70645]:             <sibling id='1' value='10'/>
Jul 24 14:48:17 user nova-compute[70645]:           </distances>
Jul 24 14:48:17 user nova-compute[70645]:           <cpus num='6'>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 24 14:48:17 user nova-compute[70645]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 24 14:48:17 user nova-compute[70645]:           </cpus>
Jul 24 14:48:17 user nova-compute[70645]:         </cell>
Jul 24 14:48:17 user nova-compute[70645]:       </cells>
Jul 24 14:48:17 user nova-compute[70645]:     </topology>
Jul 24 14:48:17 user nova-compute[70645]:     <cache>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 24 14:48:17 user nova-compute[70645]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 24 14:48:17 user nova-compute[70645]:     </cache>
Jul 24 14:48:17 user nova-compute[70645]:     <secmodel>
Jul 24 14:48:17 user nova-compute[70645]:       <model>apparmor</model>
Jul 24 14:48:17 user nova-compute[70645]:       <doi>0</doi>
Jul 24 14:48:17 user nova-compute[70645]:     </secmodel>
Jul 24 14:48:17 user nova-compute[70645]:     <secmodel>
Jul 24 14:48:17 user nova-compute[70645]:       <model>dac</model>
Jul 24 14:48:17 user nova-compute[70645]:       <doi>0</doi>
Jul 24 14:48:17 user nova-compute[70645]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 24 14:48:17 user nova-compute[70645]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 24 14:48:17 user nova-compute[70645]:     </secmodel>
Jul 24 14:48:17 user nova-compute[70645]:   </host>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='alpha'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>64</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>clipper</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='armv6l'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>integratorcp</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>borzoi</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>spitz</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>nuri</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>musca-b1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>versatileab</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>kzm</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>musca-a</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>smdkc210</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sx1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>z2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>tosa</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>sabrelite</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>realview-eb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>n810</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>n800</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>versatilepb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>terrier</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mainstone</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>midway</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>musicpal</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>microbit</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>cubieboard</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>verdex</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>netduino2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>raspi2b</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>cheetah</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>highbank</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>akita</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>connex</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>collie</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>raspi0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='armv7l'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>integratorcp</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>borzoi</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>spitz</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>nuri</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>musca-b1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>versatileab</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>kzm</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>musca-a</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>smdkc210</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sx1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>z2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>tosa</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>sabrelite</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>realview-eb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>n810</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>n800</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>versatilepb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>terrier</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mainstone</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>midway</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>musicpal</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>microbit</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>cubieboard</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>verdex</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>netduino2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>raspi2b</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>cheetah</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>highbank</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>akita</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>connex</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>collie</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>raspi0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='aarch64'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>64</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>integratorcp</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>borzoi</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>spitz</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>nuri</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>musca-b1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>versatileab</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>kzm</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>musca-a</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>smdkc210</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sx1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>z2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>tosa</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>sabrelite</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>realview-eb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>n810</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>n800</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>versatilepb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>terrier</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mainstone</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>midway</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>musicpal</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>microbit</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>cubieboard</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>verdex</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>netduino2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>raspi3b</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>raspi2b</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>cheetah</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>highbank</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>akita</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>connex</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>collie</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>raspi0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <acpi default='on' toggle='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='cris'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='i686'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>x-remote</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>isapc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>microvm</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='kvm'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <pae/>
Jul 24 14:48:17 user nova-compute[70645]:       <nonpae/>
Jul 24 14:48:17 user nova-compute[70645]:       <acpi default='on' toggle='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:       <apic default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='m68k'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>an5206</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>q800</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>next-cube</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='microblaze'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='microblazeel'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='mips'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='16'>malta</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='mipsel'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='16'>malta</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='mips64'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>64</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='16'>malta</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>pica61</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>magnum</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='mips64el'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>64</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='16'>malta</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>pica61</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>magnum</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='16'>boston</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='ppc'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>g3beige</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mac99</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>ppce500</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>pegasos2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sam460ex</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>bamboo</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>40p</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>ref405ep</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>taihu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='ppc64'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>64</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2048'>powernv9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>taihu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2048'>powernv10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>ppce500</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>40p</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>pegasos2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>bamboo</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>g3beige</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mac99</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sam460ex</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>ref405ep</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2048'>powernv8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='ppc64le'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>64</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2048'>powernv9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>taihu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2048'>powernv10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>ppce500</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>40p</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>pegasos2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>bamboo</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>g3beige</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>mac99</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sam460ex</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>ref405ep</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2048'>powernv8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='riscv32'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='8'>spike</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>opentitan</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='5'>sifive_u</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sifive_e</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='8'>virt</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='riscv64'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>64</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='8'>spike</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='5'>sifive_u</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>shakti_c</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sifive_e</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='8'>virt</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='s390x'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>64</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='sh4'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>shix</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>r2d</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='sh4eb'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>64</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>shix</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>r2d</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='sparc'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>SS-5</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>SS-20</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>LX</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>SS-4</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>SS-10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>Voyager</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='sparc64'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>64</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sun4u</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>niagara</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>sun4v</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='x86_64'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>64</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>x-remote</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='1'>isapc</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>microvm</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='kvm'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <acpi default='on' toggle='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:       <apic default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='xtensa'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>sim</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>kc705</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>ml605</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>virt</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>lx200</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>lx60</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]:   <guest>
Jul 24 14:48:17 user nova-compute[70645]:     <os_type>hvm</os_type>
Jul 24 14:48:17 user nova-compute[70645]:     <arch name='xtensaeb'>
Jul 24 14:48:17 user nova-compute[70645]:       <wordsize>32</wordsize>
Jul 24 14:48:17 user nova-compute[70645]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='4'>sim</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>kc705</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>ml605</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>virt</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>lx200</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>lx60</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 24 14:48:17 user nova-compute[70645]:       <domain type='qemu'/>
Jul 24 14:48:17 user nova-compute[70645]:     </arch>
Jul 24 14:48:17 user nova-compute[70645]:     <features>
Jul 24 14:48:17 user nova-compute[70645]:       <cpuselection/>
Jul 24 14:48:17 user nova-compute[70645]:       <deviceboot/>
Jul 24 14:48:17 user nova-compute[70645]:       <disksnapshot default='on' toggle='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     </features>
Jul 24 14:48:17 user nova-compute[70645]:   </guest>
Jul 24 14:48:17 user nova-compute[70645]: </capabilities>
Jul 24 14:48:17 user nova-compute[70645]: 
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 24 14:48:17 user nova-compute[70645]: <domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 14:48:17 user nova-compute[70645]:   <domain>kvm</domain>
Jul 24 14:48:17 user nova-compute[70645]:   <machine>pc-q35-jammy</machine>
Jul 24 14:48:17 user nova-compute[70645]:   <arch>i686</arch>
Jul 24 14:48:17 user nova-compute[70645]:   <vcpu max='288'/>
Jul 24 14:48:17 user nova-compute[70645]:   <iothreads supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:   <os supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='firmware'/>
Jul 24 14:48:17 user nova-compute[70645]:     <loader supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>rom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pflash</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='readonly'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>yes</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='secure'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </loader>
Jul 24 14:48:17 user nova-compute[70645]:   </os>
Jul 24 14:48:17 user nova-compute[70645]:   <cpu>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-passthrough' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='hostPassthroughMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='maximum' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='maximumMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-model' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <vendor>Intel</vendor>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ss'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='vmx'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pcid'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='hypervisor'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arat'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='umip'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='md-clear'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibpb'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibrs'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='erms'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='lm'/>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='custom' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>qemu64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>qemu32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>phenom</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>n270</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>kvm64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>coreduo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>core2duo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>athlon</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Westmere</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Snowridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Penryn</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G5</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G4</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G1</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Nehalem</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Rome</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Milan</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Dhyana</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cooperlake</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Conroe</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>486</model>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:   </cpu>
Jul 24 14:48:17 user nova-compute[70645]:   <memoryBacking supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='sourceType'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>file</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>anonymous</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>memfd</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:   </memoryBacking>
Jul 24 14:48:17 user nova-compute[70645]:   <devices>
Jul 24 14:48:17 user nova-compute[70645]:     <disk supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='diskDevice'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>disk</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cdrom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>floppy</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>lun</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='bus'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>fdc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sata</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </disk>
Jul 24 14:48:17 user nova-compute[70645]:     <graphics supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sdl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vnc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>spice</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egl-headless</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </graphics>
Jul 24 14:48:17 user nova-compute[70645]:     <video supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='modelType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cirrus</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vmvga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>qxl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>none</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>bochs</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ramfb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </video>
Jul 24 14:48:17 user nova-compute[70645]:     <hostdev supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='mode'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>subsystem</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='startupPolicy'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>default</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>mandatory</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>requisite</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>optional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='subsysType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pci</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='capsType'/>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='pciBackend'/>
Jul 24 14:48:17 user nova-compute[70645]:     </hostdev>
Jul 24 14:48:17 user nova-compute[70645]:     <rng supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>random</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egd</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>builtin</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </rng>
Jul 24 14:48:17 user nova-compute[70645]:     <filesystem supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='driverType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>path</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>handle</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtiofs</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </filesystem>
Jul 24 14:48:17 user nova-compute[70645]:     <tpm supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-tis</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-crb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>passthrough</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>emulator</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </tpm>
Jul 24 14:48:17 user nova-compute[70645]:   </devices>
Jul 24 14:48:17 user nova-compute[70645]:   <features>
Jul 24 14:48:17 user nova-compute[70645]:     <gic supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     <vmcoreinfo supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <genid supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backingStoreInput supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backup supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <sev supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:   </features>
Jul 24 14:48:17 user nova-compute[70645]: </domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:  {{(pid=70645) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 24 14:48:17 user nova-compute[70645]: <domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 14:48:17 user nova-compute[70645]:   <domain>kvm</domain>
Jul 24 14:48:17 user nova-compute[70645]:   <machine>pc-i440fx-jammy</machine>
Jul 24 14:48:17 user nova-compute[70645]:   <arch>i686</arch>
Jul 24 14:48:17 user nova-compute[70645]:   <vcpu max='255'/>
Jul 24 14:48:17 user nova-compute[70645]:   <iothreads supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:   <os supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='firmware'/>
Jul 24 14:48:17 user nova-compute[70645]:     <loader supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>rom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pflash</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='readonly'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>yes</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='secure'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </loader>
Jul 24 14:48:17 user nova-compute[70645]:   </os>
Jul 24 14:48:17 user nova-compute[70645]:   <cpu>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-passthrough' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='hostPassthroughMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='maximum' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='maximumMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-model' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <vendor>Intel</vendor>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ss'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='vmx'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pcid'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='hypervisor'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arat'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='umip'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='md-clear'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibpb'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibrs'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='erms'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='lm'/>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='custom' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>qemu64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>qemu32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>phenom</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>n270</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>kvm64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>coreduo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>core2duo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>athlon</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Westmere</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Snowridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Penryn</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G5</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G4</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G1</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Nehalem</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Rome</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Milan</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Dhyana</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cooperlake</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Conroe</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>486</model>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:   </cpu>
Jul 24 14:48:17 user nova-compute[70645]:   <memoryBacking supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='sourceType'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>file</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>anonymous</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>memfd</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:   </memoryBacking>
Jul 24 14:48:17 user nova-compute[70645]:   <devices>
Jul 24 14:48:17 user nova-compute[70645]:     <disk supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='diskDevice'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>disk</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cdrom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>floppy</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>lun</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='bus'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ide</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>fdc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sata</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </disk>
Jul 24 14:48:17 user nova-compute[70645]:     <graphics supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sdl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vnc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>spice</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egl-headless</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </graphics>
Jul 24 14:48:17 user nova-compute[70645]:     <video supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='modelType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cirrus</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vmvga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>qxl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>none</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>bochs</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ramfb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </video>
Jul 24 14:48:17 user nova-compute[70645]:     <hostdev supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='mode'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>subsystem</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='startupPolicy'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>default</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>mandatory</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>requisite</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>optional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='subsysType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pci</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='capsType'/>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='pciBackend'/>
Jul 24 14:48:17 user nova-compute[70645]:     </hostdev>
Jul 24 14:48:17 user nova-compute[70645]:     <rng supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>random</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egd</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>builtin</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </rng>
Jul 24 14:48:17 user nova-compute[70645]:     <filesystem supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='driverType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>path</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>handle</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtiofs</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </filesystem>
Jul 24 14:48:17 user nova-compute[70645]:     <tpm supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-tis</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-crb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>passthrough</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>emulator</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </tpm>
Jul 24 14:48:17 user nova-compute[70645]:   </devices>
Jul 24 14:48:17 user nova-compute[70645]:   <features>
Jul 24 14:48:17 user nova-compute[70645]:     <gic supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     <vmcoreinfo supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <genid supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backingStoreInput supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backup supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <sev supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:   </features>
Jul 24 14:48:17 user nova-compute[70645]: </domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:  {{(pid=70645) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 24 14:48:17 user nova-compute[70645]: <domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 14:48:17 user nova-compute[70645]:   <domain>kvm</domain>
Jul 24 14:48:17 user nova-compute[70645]:   <machine>pc-i440fx-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:   <arch>i686</arch>
Jul 24 14:48:17 user nova-compute[70645]:   <vcpu max='255'/>
Jul 24 14:48:17 user nova-compute[70645]:   <iothreads supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:   <os supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='firmware'/>
Jul 24 14:48:17 user nova-compute[70645]:     <loader supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>rom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pflash</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='readonly'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>yes</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='secure'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </loader>
Jul 24 14:48:17 user nova-compute[70645]:   </os>
Jul 24 14:48:17 user nova-compute[70645]:   <cpu>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-passthrough' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='hostPassthroughMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='maximum' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='maximumMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-model' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <vendor>Intel</vendor>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ss'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='vmx'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pcid'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='hypervisor'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arat'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='umip'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='md-clear'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibpb'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibrs'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='erms'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='lm'/>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='custom' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>qemu64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>qemu32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>phenom</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>n270</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>kvm64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>coreduo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>core2duo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>athlon</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Westmere</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Snowridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Penryn</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G5</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G4</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G1</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Nehalem</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Rome</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Milan</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Dhyana</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cooperlake</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Conroe</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>486</model>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:   </cpu>
Jul 24 14:48:17 user nova-compute[70645]:   <memoryBacking supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='sourceType'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>file</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>anonymous</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>memfd</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:   </memoryBacking>
Jul 24 14:48:17 user nova-compute[70645]:   <devices>
Jul 24 14:48:17 user nova-compute[70645]:     <disk supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='diskDevice'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>disk</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cdrom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>floppy</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>lun</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='bus'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ide</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>fdc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sata</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </disk>
Jul 24 14:48:17 user nova-compute[70645]:     <graphics supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sdl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vnc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>spice</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egl-headless</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </graphics>
Jul 24 14:48:17 user nova-compute[70645]:     <video supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='modelType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cirrus</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vmvga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>qxl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>none</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>bochs</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ramfb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </video>
Jul 24 14:48:17 user nova-compute[70645]:     <hostdev supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='mode'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>subsystem</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='startupPolicy'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>default</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>mandatory</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>requisite</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>optional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='subsysType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pci</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='capsType'/>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='pciBackend'/>
Jul 24 14:48:17 user nova-compute[70645]:     </hostdev>
Jul 24 14:48:17 user nova-compute[70645]:     <rng supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>random</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egd</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>builtin</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </rng>
Jul 24 14:48:17 user nova-compute[70645]:     <filesystem supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='driverType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>path</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>handle</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtiofs</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </filesystem>
Jul 24 14:48:17 user nova-compute[70645]:     <tpm supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-tis</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-crb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>passthrough</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>emulator</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </tpm>
Jul 24 14:48:17 user nova-compute[70645]:   </devices>
Jul 24 14:48:17 user nova-compute[70645]:   <features>
Jul 24 14:48:17 user nova-compute[70645]:     <gic supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     <vmcoreinfo supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <genid supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backingStoreInput supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backup supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <sev supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:   </features>
Jul 24 14:48:17 user nova-compute[70645]: </domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:  {{(pid=70645) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 24 14:48:17 user nova-compute[70645]: <domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 14:48:17 user nova-compute[70645]:   <domain>kvm</domain>
Jul 24 14:48:17 user nova-compute[70645]:   <machine>pc-q35-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:   <arch>i686</arch>
Jul 24 14:48:17 user nova-compute[70645]:   <vcpu max='288'/>
Jul 24 14:48:17 user nova-compute[70645]:   <iothreads supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:   <os supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='firmware'/>
Jul 24 14:48:17 user nova-compute[70645]:     <loader supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>rom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pflash</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='readonly'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>yes</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='secure'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </loader>
Jul 24 14:48:17 user nova-compute[70645]:   </os>
Jul 24 14:48:17 user nova-compute[70645]:   <cpu>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-passthrough' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='hostPassthroughMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='maximum' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='maximumMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-model' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <vendor>Intel</vendor>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ss'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='vmx'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pcid'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='hypervisor'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arat'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='umip'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='md-clear'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibpb'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibrs'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='erms'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='lm'/>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='custom' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>qemu64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>qemu32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>phenom</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>n270</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>kvm64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>coreduo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>core2duo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>athlon</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Westmere</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Snowridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Penryn</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G5</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G4</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G1</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Nehalem</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Rome</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Milan</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Dhyana</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cooperlake</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Conroe</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>486</model>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:   </cpu>
Jul 24 14:48:17 user nova-compute[70645]:   <memoryBacking supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='sourceType'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>file</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>anonymous</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>memfd</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:   </memoryBacking>
Jul 24 14:48:17 user nova-compute[70645]:   <devices>
Jul 24 14:48:17 user nova-compute[70645]:     <disk supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='diskDevice'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>disk</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cdrom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>floppy</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>lun</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='bus'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>fdc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sata</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </disk>
Jul 24 14:48:17 user nova-compute[70645]:     <graphics supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sdl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vnc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>spice</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egl-headless</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </graphics>
Jul 24 14:48:17 user nova-compute[70645]:     <video supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='modelType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cirrus</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vmvga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>qxl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>none</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>bochs</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ramfb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </video>
Jul 24 14:48:17 user nova-compute[70645]:     <hostdev supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='mode'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>subsystem</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='startupPolicy'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>default</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>mandatory</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>requisite</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>optional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='subsysType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pci</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='capsType'/>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='pciBackend'/>
Jul 24 14:48:17 user nova-compute[70645]:     </hostdev>
Jul 24 14:48:17 user nova-compute[70645]:     <rng supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>random</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egd</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>builtin</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </rng>
Jul 24 14:48:17 user nova-compute[70645]:     <filesystem supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='driverType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>path</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>handle</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtiofs</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </filesystem>
Jul 24 14:48:17 user nova-compute[70645]:     <tpm supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-tis</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-crb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>passthrough</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>emulator</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </tpm>
Jul 24 14:48:17 user nova-compute[70645]:   </devices>
Jul 24 14:48:17 user nova-compute[70645]:   <features>
Jul 24 14:48:17 user nova-compute[70645]:     <gic supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     <vmcoreinfo supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <genid supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backingStoreInput supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backup supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <sev supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:   </features>
Jul 24 14:48:17 user nova-compute[70645]: </domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:  {{(pid=70645) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 24 14:48:17 user nova-compute[70645]: <domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 14:48:17 user nova-compute[70645]:   <domain>kvm</domain>
Jul 24 14:48:17 user nova-compute[70645]:   <machine>pc-q35-jammy</machine>
Jul 24 14:48:17 user nova-compute[70645]:   <arch>x86_64</arch>
Jul 24 14:48:17 user nova-compute[70645]:   <vcpu max='288'/>
Jul 24 14:48:17 user nova-compute[70645]:   <iothreads supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:   <os supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='firmware'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>efi</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:     <loader supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>rom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pflash</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='readonly'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>yes</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='secure'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>yes</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </loader>
Jul 24 14:48:17 user nova-compute[70645]:   </os>
Jul 24 14:48:17 user nova-compute[70645]:   <cpu>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-passthrough' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='hostPassthroughMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='maximum' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='maximumMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-model' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <vendor>Intel</vendor>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ss'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='vmx'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pcid'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='hypervisor'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arat'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='umip'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='md-clear'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='invtsc'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibpb'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibrs'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='rsba'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='erms'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='custom' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>qemu64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>qemu32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>phenom</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>n270</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>coreduo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>core2duo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>athlon</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Westmere</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Snowridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Penryn</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G5</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G4</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Opteron_G1</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Nehalem</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Rome</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Milan</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Dhyana</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cooperlake</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Conroe</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>486</model>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:   </cpu>
Jul 24 14:48:17 user nova-compute[70645]:   <memoryBacking supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='sourceType'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>file</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>anonymous</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>memfd</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:   </memoryBacking>
Jul 24 14:48:17 user nova-compute[70645]:   <devices>
Jul 24 14:48:17 user nova-compute[70645]:     <disk supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='diskDevice'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>disk</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cdrom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>floppy</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>lun</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='bus'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>fdc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sata</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </disk>
Jul 24 14:48:17 user nova-compute[70645]:     <graphics supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sdl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vnc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>spice</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egl-headless</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </graphics>
Jul 24 14:48:17 user nova-compute[70645]:     <video supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='modelType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cirrus</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vmvga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>qxl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>none</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>bochs</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ramfb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </video>
Jul 24 14:48:17 user nova-compute[70645]:     <hostdev supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='mode'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>subsystem</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='startupPolicy'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>default</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>mandatory</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>requisite</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>optional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='subsysType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pci</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='capsType'/>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='pciBackend'/>
Jul 24 14:48:17 user nova-compute[70645]:     </hostdev>
Jul 24 14:48:17 user nova-compute[70645]:     <rng supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>random</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egd</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>builtin</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </rng>
Jul 24 14:48:17 user nova-compute[70645]:     <filesystem supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='driverType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>path</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>handle</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtiofs</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </filesystem>
Jul 24 14:48:17 user nova-compute[70645]:     <tpm supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-tis</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-crb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>passthrough</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>emulator</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </tpm>
Jul 24 14:48:17 user nova-compute[70645]:   </devices>
Jul 24 14:48:17 user nova-compute[70645]:   <features>
Jul 24 14:48:17 user nova-compute[70645]:     <gic supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     <vmcoreinfo supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <genid supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backingStoreInput supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backup supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <sev supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:   </features>
Jul 24 14:48:17 user nova-compute[70645]: </domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:  {{(pid=70645) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 24 14:48:17 user nova-compute[70645]: <domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 14:48:17 user nova-compute[70645]:   <domain>kvm</domain>
Jul 24 14:48:17 user nova-compute[70645]:   <machine>pc-i440fx-jammy</machine>
Jul 24 14:48:17 user nova-compute[70645]:   <arch>x86_64</arch>
Jul 24 14:48:17 user nova-compute[70645]:   <vcpu max='255'/>
Jul 24 14:48:17 user nova-compute[70645]:   <iothreads supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:   <os supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='firmware'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>efi</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:     <loader supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>rom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pflash</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='readonly'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>yes</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='secure'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </loader>
Jul 24 14:48:17 user nova-compute[70645]:   </os>
Jul 24 14:48:17 user nova-compute[70645]:   <cpu>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-passthrough' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='hostPassthroughMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='maximum' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='maximumMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-model' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <vendor>Intel</vendor>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ss'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='vmx'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pcid'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='hypervisor'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arat'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='umip'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='md-clear'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='invtsc'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibpb'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibrs'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='rsba'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='erms'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='custom' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>qemu64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>qemu32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>phenom</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>n270</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>coreduo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>core2duo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>athlon</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Westmere</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Snowridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Penryn</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G5</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G4</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Opteron_G1</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Nehalem</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Rome</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Milan</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Dhyana</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cooperlake</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Conroe</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>486</model>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:   </cpu>
Jul 24 14:48:17 user nova-compute[70645]:   <memoryBacking supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='sourceType'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>file</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>anonymous</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>memfd</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:   </memoryBacking>
Jul 24 14:48:17 user nova-compute[70645]:   <devices>
Jul 24 14:48:17 user nova-compute[70645]:     <disk supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='diskDevice'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>disk</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cdrom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>floppy</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>lun</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='bus'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ide</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>fdc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sata</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </disk>
Jul 24 14:48:17 user nova-compute[70645]:     <graphics supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sdl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vnc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>spice</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egl-headless</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </graphics>
Jul 24 14:48:17 user nova-compute[70645]:     <video supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='modelType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cirrus</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vmvga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>qxl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>none</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>bochs</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ramfb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </video>
Jul 24 14:48:17 user nova-compute[70645]:     <hostdev supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='mode'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>subsystem</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='startupPolicy'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>default</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>mandatory</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>requisite</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>optional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='subsysType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pci</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='capsType'/>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='pciBackend'/>
Jul 24 14:48:17 user nova-compute[70645]:     </hostdev>
Jul 24 14:48:17 user nova-compute[70645]:     <rng supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>random</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egd</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>builtin</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </rng>
Jul 24 14:48:17 user nova-compute[70645]:     <filesystem supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='driverType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>path</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>handle</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtiofs</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </filesystem>
Jul 24 14:48:17 user nova-compute[70645]:     <tpm supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-tis</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-crb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>passthrough</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>emulator</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </tpm>
Jul 24 14:48:17 user nova-compute[70645]:   </devices>
Jul 24 14:48:17 user nova-compute[70645]:   <features>
Jul 24 14:48:17 user nova-compute[70645]:     <gic supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     <vmcoreinfo supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <genid supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backingStoreInput supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backup supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <sev supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:   </features>
Jul 24 14:48:17 user nova-compute[70645]: </domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:  {{(pid=70645) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 24 14:48:17 user nova-compute[70645]: <domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 14:48:17 user nova-compute[70645]:   <domain>kvm</domain>
Jul 24 14:48:17 user nova-compute[70645]:   <machine>pc-i440fx-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:   <arch>x86_64</arch>
Jul 24 14:48:17 user nova-compute[70645]:   <vcpu max='255'/>
Jul 24 14:48:17 user nova-compute[70645]:   <iothreads supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:   <os supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='firmware'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>efi</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:     <loader supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>rom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pflash</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='readonly'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>yes</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='secure'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </loader>
Jul 24 14:48:17 user nova-compute[70645]:   </os>
Jul 24 14:48:17 user nova-compute[70645]:   <cpu>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-passthrough' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='hostPassthroughMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='maximum' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='maximumMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-model' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <vendor>Intel</vendor>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ss'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='vmx'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pcid'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='hypervisor'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arat'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='umip'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='md-clear'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='invtsc'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibpb'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibrs'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='rsba'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='erms'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='custom' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>qemu64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>qemu32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>phenom</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>n270</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>coreduo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>core2duo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>athlon</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Westmere</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Snowridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Penryn</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G5</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G4</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Opteron_G1</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Nehalem</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Rome</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Milan</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Dhyana</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cooperlake</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Conroe</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>486</model>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:   </cpu>
Jul 24 14:48:17 user nova-compute[70645]:   <memoryBacking supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='sourceType'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>file</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>anonymous</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>memfd</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:   </memoryBacking>
Jul 24 14:48:17 user nova-compute[70645]:   <devices>
Jul 24 14:48:17 user nova-compute[70645]:     <disk supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='diskDevice'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>disk</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cdrom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>floppy</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>lun</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='bus'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ide</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>fdc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sata</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </disk>
Jul 24 14:48:17 user nova-compute[70645]:     <graphics supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sdl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vnc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>spice</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egl-headless</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </graphics>
Jul 24 14:48:17 user nova-compute[70645]:     <video supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='modelType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cirrus</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vmvga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>qxl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>none</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>bochs</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ramfb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </video>
Jul 24 14:48:17 user nova-compute[70645]:     <hostdev supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='mode'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>subsystem</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='startupPolicy'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>default</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>mandatory</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>requisite</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>optional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='subsysType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pci</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='capsType'/>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='pciBackend'/>
Jul 24 14:48:17 user nova-compute[70645]:     </hostdev>
Jul 24 14:48:17 user nova-compute[70645]:     <rng supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>random</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egd</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>builtin</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </rng>
Jul 24 14:48:17 user nova-compute[70645]:     <filesystem supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='driverType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>path</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>handle</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtiofs</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </filesystem>
Jul 24 14:48:17 user nova-compute[70645]:     <tpm supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-tis</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-crb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>passthrough</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>emulator</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </tpm>
Jul 24 14:48:17 user nova-compute[70645]:   </devices>
Jul 24 14:48:17 user nova-compute[70645]:   <features>
Jul 24 14:48:17 user nova-compute[70645]:     <gic supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     <vmcoreinfo supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <genid supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backingStoreInput supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backup supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <sev supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:   </features>
Jul 24 14:48:17 user nova-compute[70645]: </domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:  {{(pid=70645) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 24 14:48:17 user nova-compute[70645]: <domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 14:48:17 user nova-compute[70645]:   <domain>kvm</domain>
Jul 24 14:48:17 user nova-compute[70645]:   <machine>pc-q35-6.2</machine>
Jul 24 14:48:17 user nova-compute[70645]:   <arch>x86_64</arch>
Jul 24 14:48:17 user nova-compute[70645]:   <vcpu max='288'/>
Jul 24 14:48:17 user nova-compute[70645]:   <iothreads supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:   <os supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='firmware'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>efi</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:     <loader supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>rom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pflash</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='readonly'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>yes</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='secure'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>yes</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>no</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </loader>
Jul 24 14:48:17 user nova-compute[70645]:   </os>
Jul 24 14:48:17 user nova-compute[70645]:   <cpu>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-passthrough' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='hostPassthroughMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='maximum' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='maximumMigratable'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>on</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>off</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='host-model' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <vendor>Intel</vendor>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ss'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='vmx'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pcid'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='hypervisor'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arat'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='umip'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='md-clear'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='invtsc'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibpb'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='ibrs'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-stibp'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='rsba'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='erms'/>
Jul 24 14:48:17 user nova-compute[70645]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:     <mode name='custom' supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>qemu64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>qemu32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>phenom</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>pentium</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>n270</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm64</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>kvm32</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>coreduo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>core2duo</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>athlon</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Westmere</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Snowridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Skylake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>SandyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Penryn</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G5</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G4</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G3</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Opteron_G2</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Opteron_G1</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Nehalem</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>IvyBridge</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Icelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Haswell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Rome</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-Milan</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>EPYC</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Dhyana</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cooperlake</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>Conroe</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='no'>Broadwell</model>
Jul 24 14:48:17 user nova-compute[70645]:       <model usable='yes'>486</model>
Jul 24 14:48:17 user nova-compute[70645]:     </mode>
Jul 24 14:48:17 user nova-compute[70645]:   </cpu>
Jul 24 14:48:17 user nova-compute[70645]:   <memoryBacking supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:     <enum name='sourceType'>
Jul 24 14:48:17 user nova-compute[70645]:       <value>file</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>anonymous</value>
Jul 24 14:48:17 user nova-compute[70645]:       <value>memfd</value>
Jul 24 14:48:17 user nova-compute[70645]:     </enum>
Jul 24 14:48:17 user nova-compute[70645]:   </memoryBacking>
Jul 24 14:48:17 user nova-compute[70645]:   <devices>
Jul 24 14:48:17 user nova-compute[70645]:     <disk supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='diskDevice'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>disk</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cdrom</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>floppy</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>lun</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='bus'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>fdc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sata</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </disk>
Jul 24 14:48:17 user nova-compute[70645]:     <graphics supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='type'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>sdl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vnc</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>spice</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egl-headless</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </graphics>
Jul 24 14:48:17 user nova-compute[70645]:     <video supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='modelType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>cirrus</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>vmvga</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>qxl</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>none</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>bochs</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>ramfb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </video>
Jul 24 14:48:17 user nova-compute[70645]:     <hostdev supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='mode'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>subsystem</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='startupPolicy'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>default</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>mandatory</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>requisite</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>optional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='subsysType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>usb</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>pci</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>scsi</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='capsType'/>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='pciBackend'/>
Jul 24 14:48:17 user nova-compute[70645]:     </hostdev>
Jul 24 14:48:17 user nova-compute[70645]:     <rng supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtio-non-transitional</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>random</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>egd</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>builtin</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </rng>
Jul 24 14:48:17 user nova-compute[70645]:     <filesystem supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='driverType'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>path</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>handle</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>virtiofs</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </filesystem>
Jul 24 14:48:17 user nova-compute[70645]:     <tpm supported='yes'>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='model'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-tis</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>tpm-crb</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:       <enum name='backendModel'>
Jul 24 14:48:17 user nova-compute[70645]:         <value>passthrough</value>
Jul 24 14:48:17 user nova-compute[70645]:         <value>emulator</value>
Jul 24 14:48:17 user nova-compute[70645]:       </enum>
Jul 24 14:48:17 user nova-compute[70645]:     </tpm>
Jul 24 14:48:17 user nova-compute[70645]:   </devices>
Jul 24 14:48:17 user nova-compute[70645]:   <features>
Jul 24 14:48:17 user nova-compute[70645]:     <gic supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:     <vmcoreinfo supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <genid supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backingStoreInput supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <backup supported='yes'/>
Jul 24 14:48:17 user nova-compute[70645]:     <sev supported='no'/>
Jul 24 14:48:17 user nova-compute[70645]:   </features>
Jul 24 14:48:17 user nova-compute[70645]: </domainCapabilities>
Jul 24 14:48:17 user nova-compute[70645]:  {{(pid=70645) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=70645) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=70645) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Checking secure boot support for host arch (x86_64) {{(pid=70645) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 24 14:48:17 user nova-compute[70645]: INFO nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Secure Boot support detected
Jul 24 14:48:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] cpu compare xml: <cpu match="exact">
Jul 24 14:48:17 user nova-compute[70645]:   <model>Nehalem</model>
Jul 24 14:48:17 user nova-compute[70645]: </cpu>
Jul 24 14:48:17 user nova-compute[70645]:  {{(pid=70645) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 24 14:48:17 user nova-compute[70645]: INFO nova.virt.node [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Generated node identity a0cf5b80-69d2-4191-894e-a498eab7d688
Jul 24 14:48:17 user nova-compute[70645]: INFO nova.virt.node [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Wrote node identity a0cf5b80-69d2-4191-894e-a498eab7d688 to /opt/stack/data/nova/compute_id
Jul 24 14:48:17 user nova-compute[70645]: WARNING nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Compute nodes ['a0cf5b80-69d2-4191-894e-a498eab7d688'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 24 14:48:18 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 24 14:48:18 user nova-compute[70645]: WARNING nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 24 14:48:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:48:18 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:48:18 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Hypervisor/Node resource view: name=user free_ram=10915MB free_disk=26.426837921142578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:48:18 user nova-compute[70645]: WARNING nova.compute.resource_tracker [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] No compute node record for user:a0cf5b80-69d2-4191-894e-a498eab7d688: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host a0cf5b80-69d2-4191-894e-a498eab7d688 could not be found.
Jul 24 14:48:18 user nova-compute[70645]: INFO nova.compute.resource_tracker [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Compute node record created for user:user with uuid: a0cf5b80-69d2-4191-894e-a498eab7d688
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:48:18 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [req-ac7d293b-0c4f-41fe-b65b-e7dc98a086c2] Created resource provider record via placement API for resource provider with UUID a0cf5b80-69d2-4191-894e-a498eab7d688 and name user.
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=70645) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 24 14:48:18 user nova-compute[70645]: INFO nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] kernel doesn't support AMD SEV
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Libvirt baseline CPU <cpu>
Jul 24 14:48:18 user nova-compute[70645]:   <arch>x86_64</arch>
Jul 24 14:48:18 user nova-compute[70645]:   <model>Nehalem</model>
Jul 24 14:48:18 user nova-compute[70645]:   <vendor>Intel</vendor>
Jul 24 14:48:18 user nova-compute[70645]:   <topology sockets="6" cores="1" threads="1"/>
Jul 24 14:48:18 user nova-compute[70645]: </cpu>
Jul 24 14:48:18 user nova-compute[70645]:  {{(pid=70645) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Updated inventory for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Updating resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 generation from 0 to 1 during operation: update_inventory {{(pid=70645) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 14:48:18 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Updating resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 generation from 1 to 2 during operation: update_traits {{(pid=70645) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 24 14:48:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:48:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:48:19 user nova-compute[70645]: DEBUG nova.service [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Creating RPC server for service compute {{(pid=70645) start /opt/stack/nova/nova/service.py:182}}
Jul 24 14:48:19 user nova-compute[70645]: DEBUG nova.service [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Join ServiceGroup membership for this service compute {{(pid=70645) start /opt/stack/nova/nova/service.py:199}}
Jul 24 14:48:19 user nova-compute[70645]: DEBUG nova.servicegroup.drivers.db [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=70645) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 24 14:48:33 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:48:33 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:49:09 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:49:10 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:49:10 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:49:10 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=10296MB free_disk=26.330814361572266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:49:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:49:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:49:10 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:49:10 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:49:10 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:49:10 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:49:10 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:49:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:50:10 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:50:10 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:50:10 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:50:10 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:50:10 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:50:10 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:50:11 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:50:12 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:50:12 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:50:12 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=10257MB free_disk=26.375823974609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:50:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:50:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:50:12 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:50:12 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:50:12 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:50:12 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:50:12 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:50:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:51:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:51:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:51:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:51:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:51:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:51:12 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 14:51:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:51:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:51:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:51:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:51:12 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:51:13 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:51:13 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:51:13 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=10241MB free_disk=26.149860382080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:51:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:51:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:51:13 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:51:13 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:51:13 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:51:13 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:51:13 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:51:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:51:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:51:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 14:51:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 14:51:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 14:51:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:51:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:52:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:52:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:52:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:52:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:52:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:52:12 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 14:52:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:52:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:12 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:52:13 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:13 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:13 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=9529MB free_disk=26.172645568847656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:52:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:13 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:52:13 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:52:13 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:52:13 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:52:13 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:52:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:52:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:52:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:52:15 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:52:15 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 14:52:15 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 14:52:15 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 14:52:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "b13c0261-b25c-48ce-9245-fa43dadc1829" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:52:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:52:19 user nova-compute[70645]: INFO nova.compute.claims [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Claim successful on node user
Jul 24 14:52:19 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:52:19 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:52:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:52:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:52:20 user nova-compute[70645]: DEBUG nova.network.neutron [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:52:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:52:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:52:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:52:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:52:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Creating image(s)
Jul 24 14:52:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "/opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "/opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "/opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b.part --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:21 user nova-compute[70645]: DEBUG nova.policy [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '192b7bd8dd234dceadc22ba7bb092344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab8baa391424072ba5bcea7f54f0242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:52:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b.part --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:21 user nova-compute[70645]: DEBUG nova.virt.images [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] b4bccd44-68c1-4fe3-8a56-c3963153c7de was qcow2, converting to raw {{(pid=70645) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 14:52:21 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 14:52:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b.part /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b.converted {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b.part /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b.converted" returned: 0 in 0.205s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b.converted --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b.converted --force-share --output=json" returned: 0 in 0.129s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.393s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:21 user nova-compute[70645]: INFO oslo.privsep.daemon [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1nm53d2x/privsep.sock']
Jul 24 14:52:21 user sudo[79777]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1nm53d2x/privsep.sock
Jul 24 14:52:21 user sudo[79777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 24 14:52:23 user sudo[79777]: pam_unix(sudo:session): session closed for user root
Jul 24 14:52:23 user nova-compute[70645]: INFO oslo.privsep.daemon [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Spawned new privsep daemon via rootwrap
Jul 24 14:52:23 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 24 14:52:23 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 24 14:52:23 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 24 14:52:23 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79786
Jul 24 14:52:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:52:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.155s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:52:23 user nova-compute[70645]: INFO nova.compute.claims [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Claim successful on node user
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.184s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk 1073741824" returned: 0 in 0.054s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.174s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Successfully created port: 94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:52:24 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Cannot resize image /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.objects.instance [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'migration_context' on Instance uuid b13c0261-b25c-48ce-9245-fa43dadc1829 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Ensure instance console log exists: /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:52:24 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Creating image(s)
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "/opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "/opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.124s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG nova.policy [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c27b0d1a7806484e99a8c8f7646ac9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a317c1438c54fd499cf503d88f0ee19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.125s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk 1073741824" returned: 0 in 0.043s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.129s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Cannot resize image /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG nova.objects.instance [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lazy-loading 'migration_context' on Instance uuid c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Ensure instance console log exists: /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:27 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Successfully created port: b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:52:28 user nova-compute[70645]: DEBUG nova.network.neutron [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Successfully updated port: 94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:52:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquired lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:28 user nova-compute[70645]: DEBUG nova.network.neutron [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:52:28 user nova-compute[70645]: DEBUG nova.network.neutron [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Successfully updated port: b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "refresh_cache-c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquired lock "refresh_cache-c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-0dc0e958-cc1e-4a0f-a842-c1e59a460704 req-d95d7861-d5a6-466e-ba83-9752e0dffe8a service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Received event network-changed-94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-0dc0e958-cc1e-4a0f-a842-c1e59a460704 req-d95d7861-d5a6-466e-ba83-9752e0dffe8a service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Refreshing instance network info cache due to event network-changed-94c06498-d47d-431b-9c83-3c6b7b50e1df. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0dc0e958-cc1e-4a0f-a842-c1e59a460704 req-d95d7861-d5a6-466e-ba83-9752e0dffe8a service nova] Acquiring lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.network.neutron [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Updating instance_info_cache with network_info: [{"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Releasing lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Instance network_info: |[{"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0dc0e958-cc1e-4a0f-a842-c1e59a460704 req-d95d7861-d5a6-466e-ba83-9752e0dffe8a service nova] Acquired lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.network.neutron [req-0dc0e958-cc1e-4a0f-a842-c1e59a460704 req-d95d7861-d5a6-466e-ba83-9752e0dffe8a service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Refreshing network info cache for port 94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Start _get_guest_xml network_info=[{"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:52:29 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:29 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1062621372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1062621372',id=1,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-v0rsh5p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:20Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=b13c0261-b25c-48ce-9245-fa43dadc1829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:99:f2,bridge_name='br-int',has_traffic_filtering=True,id=94c06498-d47d-431b-9c83-3c6b7b50e1df,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c06498-d4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.objects.instance [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'pci_devices' on Instance uuid b13c0261-b25c-48ce-9245-fa43dadc1829 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:52:29 user nova-compute[70645]:   <uuid>b13c0261-b25c-48ce-9245-fa43dadc1829</uuid>
Jul 24 14:52:29 user nova-compute[70645]:   <name>instance-00000001</name>
Jul 24 14:52:29 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:52:29 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:52:29 user nova-compute[70645]:   <metadata>
Jul 24 14:52:29 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:52:29 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:52:29 user nova-compute[70645]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1062621372</nova:name>
Jul 24 14:52:29 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:52:29</nova:creationTime>
Jul 24 14:52:29 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:52:29 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:52:29 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:52:29 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:52:29 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:52:29 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:52:29 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:52:29 user nova-compute[70645]:       <nova:owner>
Jul 24 14:52:29 user nova-compute[70645]:         <nova:user uuid="192b7bd8dd234dceadc22ba7bb092344">tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member</nova:user>
Jul 24 14:52:29 user nova-compute[70645]:         <nova:project uuid="bab8baa391424072ba5bcea7f54f0242">tempest-ServerBootFromVolumeStableRescueTest-1550895590</nova:project>
Jul 24 14:52:29 user nova-compute[70645]:       </nova:owner>
Jul 24 14:52:29 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:52:29 user nova-compute[70645]:       <nova:ports>
Jul 24 14:52:29 user nova-compute[70645]:         <nova:port uuid="94c06498-d47d-431b-9c83-3c6b7b50e1df">
Jul 24 14:52:29 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 14:52:29 user nova-compute[70645]:         </nova:port>
Jul 24 14:52:29 user nova-compute[70645]:       </nova:ports>
Jul 24 14:52:29 user nova-compute[70645]:     </nova:instance>
Jul 24 14:52:29 user nova-compute[70645]:   </metadata>
Jul 24 14:52:29 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:52:29 user nova-compute[70645]:     <system>
Jul 24 14:52:29 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:52:29 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:52:29 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:52:29 user nova-compute[70645]:       <entry name="serial">b13c0261-b25c-48ce-9245-fa43dadc1829</entry>
Jul 24 14:52:29 user nova-compute[70645]:       <entry name="uuid">b13c0261-b25c-48ce-9245-fa43dadc1829</entry>
Jul 24 14:52:29 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:52:29 user nova-compute[70645]:     </system>
Jul 24 14:52:29 user nova-compute[70645]:   </sysinfo>
Jul 24 14:52:29 user nova-compute[70645]:   <os>
Jul 24 14:52:29 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:52:29 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:52:29 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:52:29 user nova-compute[70645]:   </os>
Jul 24 14:52:29 user nova-compute[70645]:   <features>
Jul 24 14:52:29 user nova-compute[70645]:     <acpi/>
Jul 24 14:52:29 user nova-compute[70645]:     <apic/>
Jul 24 14:52:29 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:52:29 user nova-compute[70645]:   </features>
Jul 24 14:52:29 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:52:29 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:52:29 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:52:29 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:52:29 user nova-compute[70645]:   </clock>
Jul 24 14:52:29 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:52:29 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:52:29 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:52:29 user nova-compute[70645]:   </cpu>
Jul 24 14:52:29 user nova-compute[70645]:   <devices>
Jul 24 14:52:29 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:52:29 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:52:29 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk"/>
Jul 24 14:52:29 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:52:29 user nova-compute[70645]:     </disk>
Jul 24 14:52:29 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:52:29 user nova-compute[70645]:       <mac address="fa:16:3e:19:99:f2"/>
Jul 24 14:52:29 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:29 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:52:29 user nova-compute[70645]:       <target dev="tap94c06498-d4"/>
Jul 24 14:52:29 user nova-compute[70645]:     </interface>
Jul 24 14:52:29 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:52:29 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/console.log" append="off"/>
Jul 24 14:52:29 user nova-compute[70645]:     </serial>
Jul 24 14:52:29 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:52:29 user nova-compute[70645]:     <video>
Jul 24 14:52:29 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:29 user nova-compute[70645]:     </video>
Jul 24 14:52:29 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:52:29 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:52:29 user nova-compute[70645]:     </rng>
Jul 24 14:52:29 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:52:29 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:52:29 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:52:29 user nova-compute[70645]:     </memballoon>
Jul 24 14:52:29 user nova-compute[70645]:   </devices>
Jul 24 14:52:29 user nova-compute[70645]: </domain>
Jul 24 14:52:29 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1062621372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1062621372',id=1,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-v0rsh5p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:20Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=b13c0261-b25c-48ce-9245-fa43dadc1829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:99:f2,bridge_name='br-int',has_traffic_filtering=True,id=94c06498-d47d-431b-9c83-3c6b7b50e1df,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c06498-d4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG os_vif [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:99:f2,bridge_name='br-int',has_traffic_filtering=True,id=94c06498-d47d-431b-9c83-3c6b7b50e1df,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c06498-d4') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Created schema index Interface.name {{(pid=70645) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Created schema index Port.name {{(pid=70645) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Created schema index Bridge.name {{(pid=70645) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [POLLOUT] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bce72fa0-a4c3-4272-be97-bc3fd42cf53e req-05b00b29-8baa-4119-bd31-57c8eb711c0b service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received event network-changed-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bce72fa0-a4c3-4272-be97-bc3fd42cf53e req-05b00b29-8baa-4119-bd31-57c8eb711c0b service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Refreshing instance network info cache due to event network-changed-b181692f-4377-4a92-81ee-8d60f6fb4c96. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bce72fa0-a4c3-4272-be97-bc3fd42cf53e req-05b00b29-8baa-4119-bd31-57c8eb711c0b service nova] Acquiring lock "refresh_cache-c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:52:29 user nova-compute[70645]: INFO oslo.privsep.daemon [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpeotw91ue/privsep.sock']
Jul 24 14:52:29 user sudo[79825]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpeotw91ue/privsep.sock
Jul 24 14:52:29 user sudo[79825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Updating instance_info_cache with network_info: [{"id": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "address": "fa:16:3e:39:c5:2a", "network": {"id": "b14f49ac-5556-4859-95b1-c023b561c024", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-256905356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a317c1438c54fd499cf503d88f0ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb181692f-43", "ovs_interfaceid": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Releasing lock "refresh_cache-c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Instance network_info: |[{"id": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "address": "fa:16:3e:39:c5:2a", "network": {"id": "b14f49ac-5556-4859-95b1-c023b561c024", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-256905356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a317c1438c54fd499cf503d88f0ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb181692f-43", "ovs_interfaceid": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bce72fa0-a4c3-4272-be97-bc3fd42cf53e req-05b00b29-8baa-4119-bd31-57c8eb711c0b service nova] Acquired lock "refresh_cache-c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.network.neutron [req-bce72fa0-a4c3-4272-be97-bc3fd42cf53e req-05b00b29-8baa-4119-bd31-57c8eb711c0b service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Refreshing network info cache for port b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Start _get_guest_xml network_info=[{"id": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "address": "fa:16:3e:39:c5:2a", "network": {"id": "b14f49ac-5556-4859-95b1-c023b561c024", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-256905356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a317c1438c54fd499cf503d88f0ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb181692f-43", "ovs_interfaceid": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:52:30 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:30 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1448032674',display_name='tempest-DeleteServersTestJSON-server-1448032674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1448032674',id=2,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a317c1438c54fd499cf503d88f0ee19',ramdisk_id='',reservation_id='r-k0n0vb5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2063757654',owner_user_name='tempest-DeleteServersTestJSON-2063757654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:25Z,user_data=None,user_id='c27b0d1a7806484e99a8c8f7646ac9e6',uuid=c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "address": "fa:16:3e:39:c5:2a", "network": {"id": "b14f49ac-5556-4859-95b1-c023b561c024", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-256905356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a317c1438c54fd499cf503d88f0ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb181692f-43", "ovs_interfaceid": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Converting VIF {"id": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "address": "fa:16:3e:39:c5:2a", "network": {"id": "b14f49ac-5556-4859-95b1-c023b561c024", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-256905356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a317c1438c54fd499cf503d88f0ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb181692f-43", "ovs_interfaceid": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:c5:2a,bridge_name='br-int',has_traffic_filtering=True,id=b181692f-4377-4a92-81ee-8d60f6fb4c96,network=Network(b14f49ac-5556-4859-95b1-c023b561c024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb181692f-43') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.objects.instance [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lazy-loading 'pci_devices' on Instance uuid c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:52:30 user nova-compute[70645]:   <uuid>c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3</uuid>
Jul 24 14:52:30 user nova-compute[70645]:   <name>instance-00000002</name>
Jul 24 14:52:30 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:52:30 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:52:30 user nova-compute[70645]:   <metadata>
Jul 24 14:52:30 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:52:30 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:52:30 user nova-compute[70645]:       <nova:name>tempest-DeleteServersTestJSON-server-1448032674</nova:name>
Jul 24 14:52:30 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:52:30</nova:creationTime>
Jul 24 14:52:30 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:52:30 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:52:30 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:52:30 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:52:30 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:52:30 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:52:30 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:52:30 user nova-compute[70645]:       <nova:owner>
Jul 24 14:52:30 user nova-compute[70645]:         <nova:user uuid="c27b0d1a7806484e99a8c8f7646ac9e6">tempest-DeleteServersTestJSON-2063757654-project-member</nova:user>
Jul 24 14:52:30 user nova-compute[70645]:         <nova:project uuid="1a317c1438c54fd499cf503d88f0ee19">tempest-DeleteServersTestJSON-2063757654</nova:project>
Jul 24 14:52:30 user nova-compute[70645]:       </nova:owner>
Jul 24 14:52:30 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:52:30 user nova-compute[70645]:       <nova:ports>
Jul 24 14:52:30 user nova-compute[70645]:         <nova:port uuid="b181692f-4377-4a92-81ee-8d60f6fb4c96">
Jul 24 14:52:30 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 14:52:30 user nova-compute[70645]:         </nova:port>
Jul 24 14:52:30 user nova-compute[70645]:       </nova:ports>
Jul 24 14:52:30 user nova-compute[70645]:     </nova:instance>
Jul 24 14:52:30 user nova-compute[70645]:   </metadata>
Jul 24 14:52:30 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:52:30 user nova-compute[70645]:     <system>
Jul 24 14:52:30 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:52:30 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:52:30 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:52:30 user nova-compute[70645]:       <entry name="serial">c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3</entry>
Jul 24 14:52:30 user nova-compute[70645]:       <entry name="uuid">c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3</entry>
Jul 24 14:52:30 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:52:30 user nova-compute[70645]:     </system>
Jul 24 14:52:30 user nova-compute[70645]:   </sysinfo>
Jul 24 14:52:30 user nova-compute[70645]:   <os>
Jul 24 14:52:30 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:52:30 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:52:30 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:52:30 user nova-compute[70645]:   </os>
Jul 24 14:52:30 user nova-compute[70645]:   <features>
Jul 24 14:52:30 user nova-compute[70645]:     <acpi/>
Jul 24 14:52:30 user nova-compute[70645]:     <apic/>
Jul 24 14:52:30 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:52:30 user nova-compute[70645]:   </features>
Jul 24 14:52:30 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:52:30 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:52:30 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:52:30 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:52:30 user nova-compute[70645]:   </clock>
Jul 24 14:52:30 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:52:30 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:52:30 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:52:30 user nova-compute[70645]:   </cpu>
Jul 24 14:52:30 user nova-compute[70645]:   <devices>
Jul 24 14:52:30 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:52:30 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:52:30 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk"/>
Jul 24 14:52:30 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:52:30 user nova-compute[70645]:     </disk>
Jul 24 14:52:30 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:52:30 user nova-compute[70645]:       <mac address="fa:16:3e:39:c5:2a"/>
Jul 24 14:52:30 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:30 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:52:30 user nova-compute[70645]:       <target dev="tapb181692f-43"/>
Jul 24 14:52:30 user nova-compute[70645]:     </interface>
Jul 24 14:52:30 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:52:30 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/console.log" append="off"/>
Jul 24 14:52:30 user nova-compute[70645]:     </serial>
Jul 24 14:52:30 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:52:30 user nova-compute[70645]:     <video>
Jul 24 14:52:30 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:30 user nova-compute[70645]:     </video>
Jul 24 14:52:30 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:52:30 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:52:30 user nova-compute[70645]:     </rng>
Jul 24 14:52:30 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:52:30 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:52:30 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:52:30 user nova-compute[70645]:     </memballoon>
Jul 24 14:52:30 user nova-compute[70645]:   </devices>
Jul 24 14:52:30 user nova-compute[70645]: </domain>
Jul 24 14:52:30 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1448032674',display_name='tempest-DeleteServersTestJSON-server-1448032674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1448032674',id=2,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a317c1438c54fd499cf503d88f0ee19',ramdisk_id='',reservation_id='r-k0n0vb5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2063757654',owner_user_name='tempest-DeleteServersTestJSON-2063757654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:25Z,user_data=None,user_id='c27b0d1a7806484e99a8c8f7646ac9e6',uuid=c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "address": "fa:16:3e:39:c5:2a", "network": {"id": "b14f49ac-5556-4859-95b1-c023b561c024", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-256905356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a317c1438c54fd499cf503d88f0ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb181692f-43", "ovs_interfaceid": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Converting VIF {"id": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "address": "fa:16:3e:39:c5:2a", "network": {"id": "b14f49ac-5556-4859-95b1-c023b561c024", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-256905356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a317c1438c54fd499cf503d88f0ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb181692f-43", "ovs_interfaceid": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:c5:2a,bridge_name='br-int',has_traffic_filtering=True,id=b181692f-4377-4a92-81ee-8d60f6fb4c96,network=Network(b14f49ac-5556-4859-95b1-c023b561c024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb181692f-43') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG os_vif [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:c5:2a,bridge_name='br-int',has_traffic_filtering=True,id=b181692f-4377-4a92-81ee-8d60f6fb4c96,network=Network(b14f49ac-5556-4859-95b1-c023b561c024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb181692f-43') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.network.neutron [req-0dc0e958-cc1e-4a0f-a842-c1e59a460704 req-d95d7861-d5a6-466e-ba83-9752e0dffe8a service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Updated VIF entry in instance network info cache for port 94c06498-d47d-431b-9c83-3c6b7b50e1df. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG nova.network.neutron [req-0dc0e958-cc1e-4a0f-a842-c1e59a460704 req-d95d7861-d5a6-466e-ba83-9752e0dffe8a service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Updating instance_info_cache with network_info: [{"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:52:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0dc0e958-cc1e-4a0f-a842-c1e59a460704 req-d95d7861-d5a6-466e-ba83-9752e0dffe8a service nova] Releasing lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:52:31 user sudo[79825]: pam_unix(sudo:session): session closed for user root
Jul 24 14:52:31 user nova-compute[70645]: INFO oslo.privsep.daemon [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Spawned new privsep daemon via rootwrap
Jul 24 14:52:31 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 24 14:52:31 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 24 14:52:31 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 24 14:52:31 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79829
Jul 24 14:52:31 user nova-compute[70645]: WARNING oslo_privsep.priv_context [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] privsep daemon already running
Jul 24 14:52:31 user nova-compute[70645]: DEBUG nova.network.neutron [req-bce72fa0-a4c3-4272-be97-bc3fd42cf53e req-05b00b29-8baa-4119-bd31-57c8eb711c0b service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Updated VIF entry in instance network info cache for port b181692f-4377-4a92-81ee-8d60f6fb4c96. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG nova.network.neutron [req-bce72fa0-a4c3-4272-be97-bc3fd42cf53e req-05b00b29-8baa-4119-bd31-57c8eb711c0b service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Updating instance_info_cache with network_info: [{"id": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "address": "fa:16:3e:39:c5:2a", "network": {"id": "b14f49ac-5556-4859-95b1-c023b561c024", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-256905356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a317c1438c54fd499cf503d88f0ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb181692f-43", "ovs_interfaceid": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bce72fa0-a4c3-4272-be97-bc3fd42cf53e req-05b00b29-8baa-4119-bd31-57c8eb711c0b service nova] Releasing lock "refresh_cache-c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94c06498-d4, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94c06498-d4, col_values=(('external_ids', {'iface-id': '94c06498-d47d-431b-9c83-3c6b7b50e1df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:99:f2', 'vm-uuid': 'b13c0261-b25c-48ce-9245-fa43dadc1829'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:31 user nova-compute[70645]: INFO os_vif [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:99:f2,bridge_name='br-int',has_traffic_filtering=True,id=94c06498-d47d-431b-9c83-3c6b7b50e1df,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c06498-d4')
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb181692f-43, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb181692f-43, col_values=(('external_ids', {'iface-id': 'b181692f-4377-4a92-81ee-8d60f6fb4c96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:c5:2a', 'vm-uuid': 'c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:31 user nova-compute[70645]: INFO os_vif [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:c5:2a,bridge_name='br-int',has_traffic_filtering=True,id=b181692f-4377-4a92-81ee-8d60f6fb4c96,network=Network(b14f49ac-5556-4859-95b1-c023b561c024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb181692f-43')
Jul 24 14:52:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:52:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No VIF found with MAC fa:16:3e:19:99:f2, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:52:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:52:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] No VIF found with MAC fa:16:3e:39:c5:2a, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:52:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-869968a5-56b6-4b40-8437-9cf8e78ff206 req-109d8092-b72b-4622-af31-92de7c287662 service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Received event network-vif-plugged-94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-869968a5-56b6-4b40-8437-9cf8e78ff206 req-109d8092-b72b-4622-af31-92de7c287662 service nova] Acquiring lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-869968a5-56b6-4b40-8437-9cf8e78ff206 req-109d8092-b72b-4622-af31-92de7c287662 service nova] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-869968a5-56b6-4b40-8437-9cf8e78ff206 req-109d8092-b72b-4622-af31-92de7c287662 service nova] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-869968a5-56b6-4b40-8437-9cf8e78ff206 req-109d8092-b72b-4622-af31-92de7c287662 service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] No waiting events found dispatching network-vif-plugged-94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:52:34 user nova-compute[70645]: WARNING nova.compute.manager [req-869968a5-56b6-4b40-8437-9cf8e78ff206 req-109d8092-b72b-4622-af31-92de7c287662 service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Received unexpected event network-vif-plugged-94c06498-d47d-431b-9c83-3c6b7b50e1df for instance with vm_state building and task_state spawning.
Jul 24 14:52:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-589d1a18-0dba-40d3-9d4a-f2d3c80d5e86 req-ba6ff958-ef8a-4a59-be1d-e20023c03977 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received event network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-589d1a18-0dba-40d3-9d4a-f2d3c80d5e86 req-ba6ff958-ef8a-4a59-be1d-e20023c03977 service nova] Acquiring lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-589d1a18-0dba-40d3-9d4a-f2d3c80d5e86 req-ba6ff958-ef8a-4a59-be1d-e20023c03977 service nova] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-589d1a18-0dba-40d3-9d4a-f2d3c80d5e86 req-ba6ff958-ef8a-4a59-be1d-e20023c03977 service nova] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-589d1a18-0dba-40d3-9d4a-f2d3c80d5e86 req-ba6ff958-ef8a-4a59-be1d-e20023c03977 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] No waiting events found dispatching network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:52:36 user nova-compute[70645]: WARNING nova.compute.manager [req-589d1a18-0dba-40d3-9d4a-f2d3c80d5e86 req-ba6ff958-ef8a-4a59-be1d-e20023c03977 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received unexpected event network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 for instance with vm_state building and task_state spawning.
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210356.7015102, b13c0261-b25c-48ce-9245-fa43dadc1829 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:52:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] VM Resumed (Lifecycle Event)
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:52:36 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Instance spawned successfully.
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:52:36 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Instance spawned successfully.
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:52:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210356.7066777, b13c0261-b25c-48ce-9245-fa43dadc1829 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:52:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] VM Started (Lifecycle Event)
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:52:37 user nova-compute[70645]: INFO nova.compute.manager [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Took 12.30 seconds to spawn the instance on the hypervisor.
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:52:37 user nova-compute[70645]: INFO nova.compute.manager [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Took 16.85 seconds to spawn the instance on the hypervisor.
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-83ffd92e-6d85-417f-b4fe-701034326545 req-08861eac-7e07-452a-95af-0abd9259a2fb service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Received event network-vif-plugged-94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-83ffd92e-6d85-417f-b4fe-701034326545 req-08861eac-7e07-452a-95af-0abd9259a2fb service nova] Acquiring lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-83ffd92e-6d85-417f-b4fe-701034326545 req-08861eac-7e07-452a-95af-0abd9259a2fb service nova] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-83ffd92e-6d85-417f-b4fe-701034326545 req-08861eac-7e07-452a-95af-0abd9259a2fb service nova] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-83ffd92e-6d85-417f-b4fe-701034326545 req-08861eac-7e07-452a-95af-0abd9259a2fb service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] No waiting events found dispatching network-vif-plugged-94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:52:37 user nova-compute[70645]: WARNING nova.compute.manager [req-83ffd92e-6d85-417f-b4fe-701034326545 req-08861eac-7e07-452a-95af-0abd9259a2fb service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Received unexpected event network-vif-plugged-94c06498-d47d-431b-9c83-3c6b7b50e1df for instance with vm_state building and task_state spawning.
Jul 24 14:52:37 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210356.8309195, c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:52:37 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] VM Resumed (Lifecycle Event)
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:52:37 user nova-compute[70645]: INFO nova.compute.manager [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Took 13.34 seconds to build instance.
Jul 24 14:52:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:52:37 user nova-compute[70645]: INFO nova.compute.claims [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Claim successful on node user
Jul 24 14:52:37 user nova-compute[70645]: INFO nova.compute.manager [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Took 17.79 seconds to build instance.
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210356.8338854, c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:52:37 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] VM Started (Lifecycle Event)
Jul 24 14:52:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e4e3e5e8-1df0-46dc-8f78-758dfbf3d4c7 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.562s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19cbf592-4ed5-46dd-9eff-6817d414e854 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.042s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:52:37 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:52:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:52:38 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Creating image(s)
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "/opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "/opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "/opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.181s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-06167539-ca35-417f-9012-c7129fed3954 req-0388b4bf-c105-49c4-a5cf-0daf384a17fb service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received event network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-06167539-ca35-417f-9012-c7129fed3954 req-0388b4bf-c105-49c4-a5cf-0daf384a17fb service nova] Acquiring lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-06167539-ca35-417f-9012-c7129fed3954 req-0388b4bf-c105-49c4-a5cf-0daf384a17fb service nova] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-06167539-ca35-417f-9012-c7129fed3954 req-0388b4bf-c105-49c4-a5cf-0daf384a17fb service nova] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-06167539-ca35-417f-9012-c7129fed3954 req-0388b4bf-c105-49c4-a5cf-0daf384a17fb service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] No waiting events found dispatching network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:52:38 user nova-compute[70645]: WARNING nova.compute.manager [req-06167539-ca35-417f-9012-c7129fed3954 req-0388b4bf-c105-49c4-a5cf-0daf384a17fb service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received unexpected event network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 for instance with vm_state active and task_state None.
Jul 24 14:52:38 user nova-compute[70645]: DEBUG nova.policy [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd2d003c18c4541b9c6f2ae64cc95f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b3ae943a2a40b6a83674d048fa7805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.203s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk 1073741824" returned: 0 in 0.079s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.184s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:52:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:39 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Cannot resize image /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:52:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lazy-loading 'migration_context' on Instance uuid 046adfbd-fa5f-45f5-ae62-ddc0f834d450 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:52:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Ensure instance console log exists: /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:52:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:41 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Successfully created port: ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:52:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:45 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Successfully updated port: ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:52:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquired lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:45 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:52:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-dcdc2439-e9bd-47fd-b833-2c114aa900d6 req-9908be9d-8b56-4a4d-aa97-f913c211de78 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Received event network-changed-ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-dcdc2439-e9bd-47fd-b833-2c114aa900d6 req-9908be9d-8b56-4a4d-aa97-f913c211de78 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Refreshing instance network info cache due to event network-changed-ae0cfcb9-c004-4e79-b81b-93401c1629c7. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:52:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-dcdc2439-e9bd-47fd-b833-2c114aa900d6 req-9908be9d-8b56-4a4d-aa97-f913c211de78 service nova] Acquiring lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:45 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:52:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Updating instance_info_cache with network_info: [{"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Releasing lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Instance network_info: |[{"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-dcdc2439-e9bd-47fd-b833-2c114aa900d6 req-9908be9d-8b56-4a4d-aa97-f913c211de78 service nova] Acquired lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-dcdc2439-e9bd-47fd-b833-2c114aa900d6 req-9908be9d-8b56-4a4d-aa97-f913c211de78 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Refreshing network info cache for port ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Start _get_guest_xml network_info=[{"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:52:47 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:47 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-789722581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-789722581',id=3,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/aTOFfjx7zBVxywZhX3SOR7dB9dUYs0a2tdsQCFgb6PPyU3MZJ/9Ynhvci08plMzAFM27bWLA3PW1Y+NohDaneE1t1PJIMpviSO4+jGN6BYIC43gRL9aGFDqvvXByGgA==',key_name='tempest-keypair-36914743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31b3ae943a2a40b6a83674d048fa7805',ramdisk_id='',reservation_id='r-esbwduzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-870483127',owner_user_name='tempest-ServerActionsV293TestJSON-870483127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd2d003c18c4541b9c6f2ae64cc95f6',uuid=046adfbd-fa5f-45f5-ae62-ddc0f834d450,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converting VIF {"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:5c:b2,bridge_name='br-int',has_traffic_filtering=True,id=ae0cfcb9-c004-4e79-b81b-93401c1629c7,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0cfcb9-c0') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:47 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lazy-loading 'pci_devices' on Instance uuid 046adfbd-fa5f-45f5-ae62-ddc0f834d450 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:52:48 user nova-compute[70645]:   <uuid>046adfbd-fa5f-45f5-ae62-ddc0f834d450</uuid>
Jul 24 14:52:48 user nova-compute[70645]:   <name>instance-00000003</name>
Jul 24 14:52:48 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:52:48 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:52:48 user nova-compute[70645]:   <metadata>
Jul 24 14:52:48 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:52:48 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:52:48 user nova-compute[70645]:       <nova:name>tempest-ServerActionsV293TestJSON-server-789722581</nova:name>
Jul 24 14:52:48 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:52:47</nova:creationTime>
Jul 24 14:52:48 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:52:48 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:52:48 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:52:48 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:52:48 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:52:48 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:52:48 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:52:48 user nova-compute[70645]:       <nova:owner>
Jul 24 14:52:48 user nova-compute[70645]:         <nova:user uuid="bcd2d003c18c4541b9c6f2ae64cc95f6">tempest-ServerActionsV293TestJSON-870483127-project-member</nova:user>
Jul 24 14:52:48 user nova-compute[70645]:         <nova:project uuid="31b3ae943a2a40b6a83674d048fa7805">tempest-ServerActionsV293TestJSON-870483127</nova:project>
Jul 24 14:52:48 user nova-compute[70645]:       </nova:owner>
Jul 24 14:52:48 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:52:48 user nova-compute[70645]:       <nova:ports>
Jul 24 14:52:48 user nova-compute[70645]:         <nova:port uuid="ae0cfcb9-c004-4e79-b81b-93401c1629c7">
Jul 24 14:52:48 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 14:52:48 user nova-compute[70645]:         </nova:port>
Jul 24 14:52:48 user nova-compute[70645]:       </nova:ports>
Jul 24 14:52:48 user nova-compute[70645]:     </nova:instance>
Jul 24 14:52:48 user nova-compute[70645]:   </metadata>
Jul 24 14:52:48 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:52:48 user nova-compute[70645]:     <system>
Jul 24 14:52:48 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:52:48 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:52:48 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:52:48 user nova-compute[70645]:       <entry name="serial">046adfbd-fa5f-45f5-ae62-ddc0f834d450</entry>
Jul 24 14:52:48 user nova-compute[70645]:       <entry name="uuid">046adfbd-fa5f-45f5-ae62-ddc0f834d450</entry>
Jul 24 14:52:48 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:52:48 user nova-compute[70645]:     </system>
Jul 24 14:52:48 user nova-compute[70645]:   </sysinfo>
Jul 24 14:52:48 user nova-compute[70645]:   <os>
Jul 24 14:52:48 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:52:48 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:52:48 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:52:48 user nova-compute[70645]:   </os>
Jul 24 14:52:48 user nova-compute[70645]:   <features>
Jul 24 14:52:48 user nova-compute[70645]:     <acpi/>
Jul 24 14:52:48 user nova-compute[70645]:     <apic/>
Jul 24 14:52:48 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:52:48 user nova-compute[70645]:   </features>
Jul 24 14:52:48 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:52:48 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:52:48 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:52:48 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:52:48 user nova-compute[70645]:   </clock>
Jul 24 14:52:48 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:52:48 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:52:48 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:52:48 user nova-compute[70645]:   </cpu>
Jul 24 14:52:48 user nova-compute[70645]:   <devices>
Jul 24 14:52:48 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:52:48 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:52:48 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk"/>
Jul 24 14:52:48 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:52:48 user nova-compute[70645]:     </disk>
Jul 24 14:52:48 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:52:48 user nova-compute[70645]:       <mac address="fa:16:3e:79:5c:b2"/>
Jul 24 14:52:48 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:48 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:52:48 user nova-compute[70645]:       <target dev="tapae0cfcb9-c0"/>
Jul 24 14:52:48 user nova-compute[70645]:     </interface>
Jul 24 14:52:48 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:52:48 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/console.log" append="off"/>
Jul 24 14:52:48 user nova-compute[70645]:     </serial>
Jul 24 14:52:48 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:52:48 user nova-compute[70645]:     <video>
Jul 24 14:52:48 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:48 user nova-compute[70645]:     </video>
Jul 24 14:52:48 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:52:48 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:52:48 user nova-compute[70645]:     </rng>
Jul 24 14:52:48 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:52:48 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:52:48 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:52:48 user nova-compute[70645]:     </memballoon>
Jul 24 14:52:48 user nova-compute[70645]:   </devices>
Jul 24 14:52:48 user nova-compute[70645]: </domain>
Jul 24 14:52:48 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-789722581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-789722581',id=3,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/aTOFfjx7zBVxywZhX3SOR7dB9dUYs0a2tdsQCFgb6PPyU3MZJ/9Ynhvci08plMzAFM27bWLA3PW1Y+NohDaneE1t1PJIMpviSO4+jGN6BYIC43gRL9aGFDqvvXByGgA==',key_name='tempest-keypair-36914743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31b3ae943a2a40b6a83674d048fa7805',ramdisk_id='',reservation_id='r-esbwduzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-870483127',owner_user_name='tempest-ServerActionsV293TestJSON-870483127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd2d003c18c4541b9c6f2ae64cc95f6',uuid=046adfbd-fa5f-45f5-ae62-ddc0f834d450,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converting VIF {"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:5c:b2,bridge_name='br-int',has_traffic_filtering=True,id=ae0cfcb9-c004-4e79-b81b-93401c1629c7,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0cfcb9-c0') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG os_vif [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:5c:b2,bridge_name='br-int',has_traffic_filtering=True,id=ae0cfcb9-c004-4e79-b81b-93401c1629c7,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0cfcb9-c0') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae0cfcb9-c0, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae0cfcb9-c0, col_values=(('external_ids', {'iface-id': 'ae0cfcb9-c004-4e79-b81b-93401c1629c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:5c:b2', 'vm-uuid': '046adfbd-fa5f-45f5-ae62-ddc0f834d450'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:48 user nova-compute[70645]: INFO os_vif [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:5c:b2,bridge_name='br-int',has_traffic_filtering=True,id=ae0cfcb9-c004-4e79-b81b-93401c1629c7,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0cfcb9-c0')
Jul 24 14:52:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] No VIF found with MAC fa:16:3e:79:5c:b2, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-dcdc2439-e9bd-47fd-b833-2c114aa900d6 req-9908be9d-8b56-4a4d-aa97-f913c211de78 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Updated VIF entry in instance network info cache for port ae0cfcb9-c004-4e79-b81b-93401c1629c7. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:52:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-dcdc2439-e9bd-47fd-b833-2c114aa900d6 req-9908be9d-8b56-4a4d-aa97-f913c211de78 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Updating instance_info_cache with network_info: [{"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:52:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-dcdc2439-e9bd-47fd-b833-2c114aa900d6 req-9908be9d-8b56-4a4d-aa97-f913c211de78 service nova] Releasing lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:52:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-6774af25-ddcf-40d1-802f-afb740ad1071 req-bdadccf2-effb-46bc-95d7-c991186d5c73 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Received event network-vif-plugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6774af25-ddcf-40d1-802f-afb740ad1071 req-bdadccf2-effb-46bc-95d7-c991186d5c73 service nova] Acquiring lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6774af25-ddcf-40d1-802f-afb740ad1071 req-bdadccf2-effb-46bc-95d7-c991186d5c73 service nova] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6774af25-ddcf-40d1-802f-afb740ad1071 req-bdadccf2-effb-46bc-95d7-c991186d5c73 service nova] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-6774af25-ddcf-40d1-802f-afb740ad1071 req-bdadccf2-effb-46bc-95d7-c991186d5c73 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] No waiting events found dispatching network-vif-plugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:52:50 user nova-compute[70645]: WARNING nova.compute.manager [req-6774af25-ddcf-40d1-802f-afb740ad1071 req-bdadccf2-effb-46bc-95d7-c991186d5c73 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Received unexpected event network-vif-plugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 for instance with vm_state building and task_state spawning.
Jul 24 14:52:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "f1a667e2-7992-44e4-9500-fa598493e173" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:52:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:52:51 user nova-compute[70645]: INFO nova.compute.claims [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Claim successful on node user
Jul 24 14:52:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Acquiring lock "07268543-d6a3-479b-a4b9-e0cc87bb068a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.184s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:52:52 user nova-compute[70645]: INFO nova.compute.claims [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Claim successful on node user
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:52:52 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e68b86b-940b-4880-a81e-ec99868ceeb5 req-6c67cc98-4c7b-4640-9de0-61426a324333 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Received event network-vif-plugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e68b86b-940b-4880-a81e-ec99868ceeb5 req-6c67cc98-4c7b-4640-9de0-61426a324333 service nova] Acquiring lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e68b86b-940b-4880-a81e-ec99868ceeb5 req-6c67cc98-4c7b-4640-9de0-61426a324333 service nova] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e68b86b-940b-4880-a81e-ec99868ceeb5 req-6c67cc98-4c7b-4640-9de0-61426a324333 service nova] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e68b86b-940b-4880-a81e-ec99868ceeb5 req-6c67cc98-4c7b-4640-9de0-61426a324333 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] No waiting events found dispatching network-vif-plugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:52:52 user nova-compute[70645]: WARNING nova.compute.manager [req-3e68b86b-940b-4880-a81e-ec99868ceeb5 req-6c67cc98-4c7b-4640-9de0-61426a324333 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Received unexpected event network-vif-plugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 for instance with vm_state building and task_state spawning.
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:52:52 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Creating image(s)
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "/opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "/opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG nova.policy [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad0dc6a130114d50b702de26be47c3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a447bf5ed203471ab178b4433a1c40ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.169s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210373.065379, 046adfbd-fa5f-45f5-ae62-ddc0f834d450 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:52:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] VM Resumed (Lifecycle Event)
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:52:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Instance spawned successfully.
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.820s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.243s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk 1073741824" returned: 0 in 0.116s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:52:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210373.0655987, 046adfbd-fa5f-45f5-ae62-ddc0f834d450 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:52:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] VM Started (Lifecycle Event)
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:52:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:52:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.212s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:52:53 user nova-compute[70645]: INFO nova.compute.manager [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Took 15.40 seconds to spawn the instance on the hypervisor.
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Cannot resize image /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.objects.instance [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lazy-loading 'migration_context' on Instance uuid f1a667e2-7992-44e4-9500-fa598493e173 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Ensure instance console log exists: /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.policy [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081e1e09648c44789781713d80e8749c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446386c2f44f4b1e9a8c072d79ba64ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:52:53 user nova-compute[70645]: INFO nova.compute.manager [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Took 16.66 seconds to build instance.
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:52:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Creating image(s)
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Acquiring lock "/opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "/opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "/opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a374669-94eb-4855-bf00-9b81bea7c5f1 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.256s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:52:54 user nova-compute[70645]: INFO nova.compute.claims [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Claim successful on node user
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.217s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk 1073741824" returned: 0 in 0.109s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.402s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Successfully created port: 014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.225s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Successfully created port: a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.734s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Cannot resize image /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG nova.objects.instance [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lazy-loading 'migration_context' on Instance uuid 07268543-d6a3-479b-a4b9-e0cc87bb068a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Ensure instance console log exists: /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:52:55 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 24 14:52:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG nova.policy [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88449d0e7b294376884edb24722bbd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f383c938a0a44aa994cf1d464f94e34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:52:55 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Creating image(s)
Jul 24 14:52:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "/opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "/opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "cf46fe923edcbff325bca4864af4d0b13d79e65e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "cf46fe923edcbff325bca4864af4d0b13d79e65e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e.part --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e.part --force-share --output=json" returned: 0 in 0.166s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG nova.virt.images [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] dcd48dec-7021-4cfa-bd29-b9c55c2f2cd4 was qcow2, converting to raw {{(pid=70645) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 14:52:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e.part /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e.converted {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e.part /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e.converted" returned: 0 in 0.226s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e.converted --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e.converted --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "cf46fe923edcbff325bca4864af4d0b13d79e65e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.058s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e --force-share --output=json" returned: 0 in 0.152s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "cf46fe923edcbff325bca4864af4d0b13d79e65e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "cf46fe923edcbff325bca4864af4d0b13d79e65e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Successfully updated port: 014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG nova.compute.manager [req-5744a5dd-1aa9-4eb3-be57-077156bdfae3 req-f9ebfade-a69e-48be-bcdf-590a68563b22 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Received event network-changed-014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG nova.compute.manager [req-5744a5dd-1aa9-4eb3-be57-077156bdfae3 req-f9ebfade-a69e-48be-bcdf-590a68563b22 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Refreshing instance network info cache due to event network-changed-014795b1-c234-4335-acff-79b1fbab054f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5744a5dd-1aa9-4eb3-be57-077156bdfae3 req-f9ebfade-a69e-48be-bcdf-590a68563b22 service nova] Acquiring lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5744a5dd-1aa9-4eb3-be57-077156bdfae3 req-f9ebfade-a69e-48be-bcdf-590a68563b22 service nova] Acquired lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG nova.network.neutron [req-5744a5dd-1aa9-4eb3-be57-077156bdfae3 req-f9ebfade-a69e-48be-bcdf-590a68563b22 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Refreshing network info cache for port 014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Successfully created port: 24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e --force-share --output=json" returned: 0 in 0.207s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e,backing_fmt=raw /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e,backing_fmt=raw /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk 1073741824" returned: 0 in 0.057s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "cf46fe923edcbff325bca4864af4d0b13d79e65e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:56 user nova-compute[70645]: DEBUG nova.network.neutron [req-5744a5dd-1aa9-4eb3-be57-077156bdfae3 req-f9ebfade-a69e-48be-bcdf-590a68563b22 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e --force-share --output=json" returned: 0 in 0.168s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Successfully updated port: a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Acquiring lock "refresh_cache-07268543-d6a3-479b-a4b9-e0cc87bb068a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Acquired lock "refresh_cache-07268543-d6a3-479b-a4b9-e0cc87bb068a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-00a0e432-35f7-4f84-ab51-60f516dea9f0 req-d76b3245-3287-4102-9c15-8916bfd5e039 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-changed-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-00a0e432-35f7-4f84-ab51-60f516dea9f0 req-d76b3245-3287-4102-9c15-8916bfd5e039 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Refreshing instance network info cache due to event network-changed-a650a482-e323-4826-93ef-c9cdece514b2. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-00a0e432-35f7-4f84-ab51-60f516dea9f0 req-d76b3245-3287-4102-9c15-8916bfd5e039 service nova] Acquiring lock "refresh_cache-07268543-d6a3-479b-a4b9-e0cc87bb068a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Cannot resize image /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.objects.instance [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lazy-loading 'migration_context' on Instance uuid ea55b3b9-4821-4400-b99f-ba233c2a7395 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Ensure instance console log exists: /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.network.neutron [req-5744a5dd-1aa9-4eb3-be57-077156bdfae3 req-f9ebfade-a69e-48be-bcdf-590a68563b22 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5744a5dd-1aa9-4eb3-be57-077156bdfae3 req-f9ebfade-a69e-48be-bcdf-590a68563b22 service nova] Releasing lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquired lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:52:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Updating instance_info_cache with network_info: [{"id": "a650a482-e323-4826-93ef-c9cdece514b2", "address": "fa:16:3e:fc:7e:d1", "network": {"id": "4e47d6a0-7724-4c9e-8841-bf267c069126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039189837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446386c2f44f4b1e9a8c072d79ba64ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa650a482-e3", "ovs_interfaceid": "a650a482-e323-4826-93ef-c9cdece514b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Releasing lock "refresh_cache-07268543-d6a3-479b-a4b9-e0cc87bb068a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Instance network_info: |[{"id": "a650a482-e323-4826-93ef-c9cdece514b2", "address": "fa:16:3e:fc:7e:d1", "network": {"id": "4e47d6a0-7724-4c9e-8841-bf267c069126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039189837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446386c2f44f4b1e9a8c072d79ba64ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa650a482-e3", "ovs_interfaceid": "a650a482-e323-4826-93ef-c9cdece514b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-00a0e432-35f7-4f84-ab51-60f516dea9f0 req-d76b3245-3287-4102-9c15-8916bfd5e039 service nova] Acquired lock "refresh_cache-07268543-d6a3-479b-a4b9-e0cc87bb068a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.neutron [req-00a0e432-35f7-4f84-ab51-60f516dea9f0 req-d76b3245-3287-4102-9c15-8916bfd5e039 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Refreshing network info cache for port a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Start _get_guest_xml network_info=[{"id": "a650a482-e323-4826-93ef-c9cdece514b2", "address": "fa:16:3e:fc:7e:d1", "network": {"id": "4e47d6a0-7724-4c9e-8841-bf267c069126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039189837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446386c2f44f4b1e9a8c072d79ba64ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa650a482-e3", "ovs_interfaceid": "a650a482-e323-4826-93ef-c9cdece514b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-119760614',display_name='tempest-VolumesActionsTest-instance-119760614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-119760614',id=5,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446386c2f44f4b1e9a8c072d79ba64ce',ramdisk_id='',reservation_id='r-6v0nwsg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-707520480',owner_user_name='tempest-VolumesActionsTest-707520480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:54Z,user_data=None,user_id='081e1e09648c44789781713d80e8749c',uuid=07268543-d6a3-479b-a4b9-e0cc87bb068a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a650a482-e323-4826-93ef-c9cdece514b2", "address": "fa:16:3e:fc:7e:d1", "network": {"id": "4e47d6a0-7724-4c9e-8841-bf267c069126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039189837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446386c2f44f4b1e9a8c072d79ba64ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa650a482-e3", "ovs_interfaceid": "a650a482-e323-4826-93ef-c9cdece514b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Converting VIF {"id": "a650a482-e323-4826-93ef-c9cdece514b2", "address": "fa:16:3e:fc:7e:d1", "network": {"id": "4e47d6a0-7724-4c9e-8841-bf267c069126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039189837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446386c2f44f4b1e9a8c072d79ba64ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa650a482-e3", "ovs_interfaceid": "a650a482-e323-4826-93ef-c9cdece514b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7e:d1,bridge_name='br-int',has_traffic_filtering=True,id=a650a482-e323-4826-93ef-c9cdece514b2,network=Network(4e47d6a0-7724-4c9e-8841-bf267c069126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa650a482-e3') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.objects.instance [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lazy-loading 'pci_devices' on Instance uuid 07268543-d6a3-479b-a4b9-e0cc87bb068a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:52:58 user nova-compute[70645]:   <uuid>07268543-d6a3-479b-a4b9-e0cc87bb068a</uuid>
Jul 24 14:52:58 user nova-compute[70645]:   <name>instance-00000005</name>
Jul 24 14:52:58 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:52:58 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:52:58 user nova-compute[70645]:   <metadata>
Jul 24 14:52:58 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:52:58 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:name>tempest-VolumesActionsTest-instance-119760614</nova:name>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:52:58</nova:creationTime>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:52:58 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:52:58 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:owner>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:user uuid="081e1e09648c44789781713d80e8749c">tempest-VolumesActionsTest-707520480-project-member</nova:user>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:project uuid="446386c2f44f4b1e9a8c072d79ba64ce">tempest-VolumesActionsTest-707520480</nova:project>
Jul 24 14:52:58 user nova-compute[70645]:       </nova:owner>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:ports>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:port uuid="a650a482-e323-4826-93ef-c9cdece514b2">
Jul 24 14:52:58 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 14:52:58 user nova-compute[70645]:         </nova:port>
Jul 24 14:52:58 user nova-compute[70645]:       </nova:ports>
Jul 24 14:52:58 user nova-compute[70645]:     </nova:instance>
Jul 24 14:52:58 user nova-compute[70645]:   </metadata>
Jul 24 14:52:58 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:52:58 user nova-compute[70645]:     <system>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="serial">07268543-d6a3-479b-a4b9-e0cc87bb068a</entry>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="uuid">07268543-d6a3-479b-a4b9-e0cc87bb068a</entry>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:52:58 user nova-compute[70645]:     </system>
Jul 24 14:52:58 user nova-compute[70645]:   </sysinfo>
Jul 24 14:52:58 user nova-compute[70645]:   <os>
Jul 24 14:52:58 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:52:58 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:52:58 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:52:58 user nova-compute[70645]:   </os>
Jul 24 14:52:58 user nova-compute[70645]:   <features>
Jul 24 14:52:58 user nova-compute[70645]:     <acpi/>
Jul 24 14:52:58 user nova-compute[70645]:     <apic/>
Jul 24 14:52:58 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:52:58 user nova-compute[70645]:   </features>
Jul 24 14:52:58 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:52:58 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:52:58 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:52:58 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:52:58 user nova-compute[70645]:   </clock>
Jul 24 14:52:58 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:52:58 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:52:58 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:52:58 user nova-compute[70645]:   </cpu>
Jul 24 14:52:58 user nova-compute[70645]:   <devices>
Jul 24 14:52:58 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:52:58 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:52:58 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk"/>
Jul 24 14:52:58 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:52:58 user nova-compute[70645]:     </disk>
Jul 24 14:52:58 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:52:58 user nova-compute[70645]:       <mac address="fa:16:3e:fc:7e:d1"/>
Jul 24 14:52:58 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:58 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:52:58 user nova-compute[70645]:       <target dev="tapa650a482-e3"/>
Jul 24 14:52:58 user nova-compute[70645]:     </interface>
Jul 24 14:52:58 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:52:58 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/console.log" append="off"/>
Jul 24 14:52:58 user nova-compute[70645]:     </serial>
Jul 24 14:52:58 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:52:58 user nova-compute[70645]:     <video>
Jul 24 14:52:58 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:58 user nova-compute[70645]:     </video>
Jul 24 14:52:58 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:52:58 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:52:58 user nova-compute[70645]:     </rng>
Jul 24 14:52:58 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:52:58 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:52:58 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:52:58 user nova-compute[70645]:     </memballoon>
Jul 24 14:52:58 user nova-compute[70645]:   </devices>
Jul 24 14:52:58 user nova-compute[70645]: </domain>
Jul 24 14:52:58 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-119760614',display_name='tempest-VolumesActionsTest-instance-119760614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-119760614',id=5,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446386c2f44f4b1e9a8c072d79ba64ce',ramdisk_id='',reservation_id='r-6v0nwsg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-707520480',owner_user_name='tempest-VolumesActionsTest-707520480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:54Z,user_data=None,user_id='081e1e09648c44789781713d80e8749c',uuid=07268543-d6a3-479b-a4b9-e0cc87bb068a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a650a482-e323-4826-93ef-c9cdece514b2", "address": "fa:16:3e:fc:7e:d1", "network": {"id": "4e47d6a0-7724-4c9e-8841-bf267c069126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039189837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446386c2f44f4b1e9a8c072d79ba64ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa650a482-e3", "ovs_interfaceid": "a650a482-e323-4826-93ef-c9cdece514b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Converting VIF {"id": "a650a482-e323-4826-93ef-c9cdece514b2", "address": "fa:16:3e:fc:7e:d1", "network": {"id": "4e47d6a0-7724-4c9e-8841-bf267c069126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039189837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446386c2f44f4b1e9a8c072d79ba64ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa650a482-e3", "ovs_interfaceid": "a650a482-e323-4826-93ef-c9cdece514b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7e:d1,bridge_name='br-int',has_traffic_filtering=True,id=a650a482-e323-4826-93ef-c9cdece514b2,network=Network(4e47d6a0-7724-4c9e-8841-bf267c069126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa650a482-e3') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG os_vif [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7e:d1,bridge_name='br-int',has_traffic_filtering=True,id=a650a482-e323-4826-93ef-c9cdece514b2,network=Network(4e47d6a0-7724-4c9e-8841-bf267c069126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa650a482-e3') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa650a482-e3, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa650a482-e3, col_values=(('external_ids', {'iface-id': 'a650a482-e323-4826-93ef-c9cdece514b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:7e:d1', 'vm-uuid': '07268543-d6a3-479b-a4b9-e0cc87bb068a'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:58 user nova-compute[70645]: INFO os_vif [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7e:d1,bridge_name='br-int',has_traffic_filtering=True,id=a650a482-e323-4826-93ef-c9cdece514b2,network=Network(4e47d6a0-7724-4c9e-8841-bf267c069126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa650a482-e3')
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Updating instance_info_cache with network_info: [{"id": "014795b1-c234-4335-acff-79b1fbab054f", "address": "fa:16:3e:4d:44:3f", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014795b1-c2", "ovs_interfaceid": "014795b1-c234-4335-acff-79b1fbab054f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] No VIF found with MAC fa:16:3e:fc:7e:d1, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Releasing lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Instance network_info: |[{"id": "014795b1-c234-4335-acff-79b1fbab054f", "address": "fa:16:3e:4d:44:3f", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014795b1-c2", "ovs_interfaceid": "014795b1-c234-4335-acff-79b1fbab054f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Start _get_guest_xml network_info=[{"id": "014795b1-c234-4335-acff-79b1fbab054f", "address": "fa:16:3e:4d:44:3f", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014795b1-c2", "ovs_interfaceid": "014795b1-c234-4335-acff-79b1fbab054f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:52:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-277836927',display_name='tempest-VolumesAdminNegativeTest-server-277836927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-277836927',id=4,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBEMvH71kMDeV9PbYWIRXYgvaeeLhBCKYNCQZWUmqzuPPVkzoAaPlw05OXDu2joEy9KiAkCtw/+uwt96fyGNbH7nxoS5+dRstXP1kJWq+h0Vfp9wdZCUF4iAbk4NHd87w==',key_name='tempest-keypair-1716874696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a447bf5ed203471ab178b4433a1c40ce',ramdisk_id='',reservation_id='r-yzmbjspm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1454211316',owner_user_name='tempest-VolumesAdminNegativeTest-1454211316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad0dc6a130114d50b702de26be47c3a0',uuid=f1a667e2-7992-44e4-9500-fa598493e173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "014795b1-c234-4335-acff-79b1fbab054f", "address": "fa:16:3e:4d:44:3f", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014795b1-c2", "ovs_interfaceid": "014795b1-c234-4335-acff-79b1fbab054f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converting VIF {"id": "014795b1-c234-4335-acff-79b1fbab054f", "address": "fa:16:3e:4d:44:3f", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014795b1-c2", "ovs_interfaceid": "014795b1-c234-4335-acff-79b1fbab054f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:44:3f,bridge_name='br-int',has_traffic_filtering=True,id=014795b1-c234-4335-acff-79b1fbab054f,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014795b1-c2') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.objects.instance [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lazy-loading 'pci_devices' on Instance uuid f1a667e2-7992-44e4-9500-fa598493e173 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:52:58 user nova-compute[70645]:   <uuid>f1a667e2-7992-44e4-9500-fa598493e173</uuid>
Jul 24 14:52:58 user nova-compute[70645]:   <name>instance-00000004</name>
Jul 24 14:52:58 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:52:58 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:52:58 user nova-compute[70645]:   <metadata>
Jul 24 14:52:58 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:52:58 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:name>tempest-VolumesAdminNegativeTest-server-277836927</nova:name>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:52:58</nova:creationTime>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:52:58 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:52:58 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:owner>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:user uuid="ad0dc6a130114d50b702de26be47c3a0">tempest-VolumesAdminNegativeTest-1454211316-project-member</nova:user>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:project uuid="a447bf5ed203471ab178b4433a1c40ce">tempest-VolumesAdminNegativeTest-1454211316</nova:project>
Jul 24 14:52:58 user nova-compute[70645]:       </nova:owner>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:52:58 user nova-compute[70645]:       <nova:ports>
Jul 24 14:52:58 user nova-compute[70645]:         <nova:port uuid="014795b1-c234-4335-acff-79b1fbab054f">
Jul 24 14:52:58 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 14:52:58 user nova-compute[70645]:         </nova:port>
Jul 24 14:52:58 user nova-compute[70645]:       </nova:ports>
Jul 24 14:52:58 user nova-compute[70645]:     </nova:instance>
Jul 24 14:52:58 user nova-compute[70645]:   </metadata>
Jul 24 14:52:58 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:52:58 user nova-compute[70645]:     <system>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="serial">f1a667e2-7992-44e4-9500-fa598493e173</entry>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="uuid">f1a667e2-7992-44e4-9500-fa598493e173</entry>
Jul 24 14:52:58 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:52:58 user nova-compute[70645]:     </system>
Jul 24 14:52:58 user nova-compute[70645]:   </sysinfo>
Jul 24 14:52:58 user nova-compute[70645]:   <os>
Jul 24 14:52:58 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:52:58 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:52:58 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:52:58 user nova-compute[70645]:   </os>
Jul 24 14:52:58 user nova-compute[70645]:   <features>
Jul 24 14:52:58 user nova-compute[70645]:     <acpi/>
Jul 24 14:52:58 user nova-compute[70645]:     <apic/>
Jul 24 14:52:58 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:52:58 user nova-compute[70645]:   </features>
Jul 24 14:52:58 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:52:58 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:52:58 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:52:58 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:52:58 user nova-compute[70645]:   </clock>
Jul 24 14:52:58 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:52:58 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:52:58 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:52:58 user nova-compute[70645]:   </cpu>
Jul 24 14:52:58 user nova-compute[70645]:   <devices>
Jul 24 14:52:58 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:52:58 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:52:58 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk"/>
Jul 24 14:52:58 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:52:58 user nova-compute[70645]:     </disk>
Jul 24 14:52:58 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:52:58 user nova-compute[70645]:       <mac address="fa:16:3e:4d:44:3f"/>
Jul 24 14:52:58 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:58 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:52:58 user nova-compute[70645]:       <target dev="tap014795b1-c2"/>
Jul 24 14:52:58 user nova-compute[70645]:     </interface>
Jul 24 14:52:58 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:52:58 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/console.log" append="off"/>
Jul 24 14:52:58 user nova-compute[70645]:     </serial>
Jul 24 14:52:58 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:52:58 user nova-compute[70645]:     <video>
Jul 24 14:52:58 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:58 user nova-compute[70645]:     </video>
Jul 24 14:52:58 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:52:58 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:52:58 user nova-compute[70645]:     </rng>
Jul 24 14:52:58 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:52:58 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:52:58 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:52:58 user nova-compute[70645]:     </memballoon>
Jul 24 14:52:58 user nova-compute[70645]:   </devices>
Jul 24 14:52:58 user nova-compute[70645]: </domain>
Jul 24 14:52:58 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-277836927',display_name='tempest-VolumesAdminNegativeTest-server-277836927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-277836927',id=4,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBEMvH71kMDeV9PbYWIRXYgvaeeLhBCKYNCQZWUmqzuPPVkzoAaPlw05OXDu2joEy9KiAkCtw/+uwt96fyGNbH7nxoS5+dRstXP1kJWq+h0Vfp9wdZCUF4iAbk4NHd87w==',key_name='tempest-keypair-1716874696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a447bf5ed203471ab178b4433a1c40ce',ramdisk_id='',reservation_id='r-yzmbjspm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1454211316',owner_user_name='tempest-VolumesAdminNegativeTest-1454211316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad0dc6a130114d50b702de26be47c3a0',uuid=f1a667e2-7992-44e4-9500-fa598493e173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "014795b1-c234-4335-acff-79b1fbab054f", "address": "fa:16:3e:4d:44:3f", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014795b1-c2", "ovs_interfaceid": "014795b1-c234-4335-acff-79b1fbab054f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converting VIF {"id": "014795b1-c234-4335-acff-79b1fbab054f", "address": "fa:16:3e:4d:44:3f", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014795b1-c2", "ovs_interfaceid": "014795b1-c234-4335-acff-79b1fbab054f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:44:3f,bridge_name='br-int',has_traffic_filtering=True,id=014795b1-c234-4335-acff-79b1fbab054f,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014795b1-c2') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG os_vif [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:44:3f,bridge_name='br-int',has_traffic_filtering=True,id=014795b1-c234-4335-acff-79b1fbab054f,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014795b1-c2') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap014795b1-c2, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap014795b1-c2, col_values=(('external_ids', {'iface-id': '014795b1-c234-4335-acff-79b1fbab054f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:44:3f', 'vm-uuid': 'f1a667e2-7992-44e4-9500-fa598493e173'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:58 user nova-compute[70645]: INFO os_vif [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:44:3f,bridge_name='br-int',has_traffic_filtering=True,id=014795b1-c234-4335-acff-79b1fbab054f,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014795b1-c2')
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] No VIF found with MAC fa:16:3e:4d:44:3f, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:52:58 user nova-compute[70645]: INFO nova.compute.claims [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Claim successful on node user
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Successfully updated port: 24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "refresh_cache-ea55b3b9-4821-4400-b99f-ba233c2a7395" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquired lock "refresh_cache-ea55b3b9-4821-4400-b99f-ba233c2a7395" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.network.neutron [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.network.neutron [req-00a0e432-35f7-4f84-ab51-60f516dea9f0 req-d76b3245-3287-4102-9c15-8916bfd5e039 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Updated VIF entry in instance network info cache for port a650a482-e323-4826-93ef-c9cdece514b2. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.network.neutron [req-00a0e432-35f7-4f84-ab51-60f516dea9f0 req-d76b3245-3287-4102-9c15-8916bfd5e039 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Updating instance_info_cache with network_info: [{"id": "a650a482-e323-4826-93ef-c9cdece514b2", "address": "fa:16:3e:fc:7e:d1", "network": {"id": "4e47d6a0-7724-4c9e-8841-bf267c069126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039189837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446386c2f44f4b1e9a8c072d79ba64ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa650a482-e3", "ovs_interfaceid": "a650a482-e323-4826-93ef-c9cdece514b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-00a0e432-35f7-4f84-ab51-60f516dea9f0 req-d76b3245-3287-4102-9c15-8916bfd5e039 service nova] Releasing lock "refresh_cache-07268543-d6a3-479b-a4b9-e0cc87bb068a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-1cc1f3c3-6abe-4615-9584-58840b29c9d5 req-99c9b415-c983-431b-92e5-2218e194f95e service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Received event network-changed-24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-1cc1f3c3-6abe-4615-9584-58840b29c9d5 req-99c9b415-c983-431b-92e5-2218e194f95e service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Refreshing instance network info cache due to event network-changed-24dcb843-5910-4f0c-bace-e9b24f5536a8. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1cc1f3c3-6abe-4615-9584-58840b29c9d5 req-99c9b415-c983-431b-92e5-2218e194f95e service nova] Acquiring lock "refresh_cache-ea55b3b9-4821-4400-b99f-ba233c2a7395" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:52:59 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:52:59 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Creating image(s)
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "/opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "/opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "/opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.network.neutron [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Updating instance_info_cache with network_info: [{"id": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "address": "fa:16:3e:ef:95:ba", "network": {"id": "8fb8583c-cd2f-4a58-96b5-8fe7c93535a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-455369873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f383c938a0a44aa994cf1d464f94e34d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24dcb843-59", "ovs_interfaceid": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.policy [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8760fdb15c6d4727b2fec40542abe913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e80c8a86e44f3f9d5a84c24675a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Releasing lock "refresh_cache-ea55b3b9-4821-4400-b99f-ba233c2a7395" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Instance network_info: |[{"id": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "address": "fa:16:3e:ef:95:ba", "network": {"id": "8fb8583c-cd2f-4a58-96b5-8fe7c93535a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-455369873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f383c938a0a44aa994cf1d464f94e34d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24dcb843-59", "ovs_interfaceid": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1cc1f3c3-6abe-4615-9584-58840b29c9d5 req-99c9b415-c983-431b-92e5-2218e194f95e service nova] Acquired lock "refresh_cache-ea55b3b9-4821-4400-b99f-ba233c2a7395" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.network.neutron [req-1cc1f3c3-6abe-4615-9584-58840b29c9d5 req-99c9b415-c983-431b-92e5-2218e194f95e service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Refreshing network info cache for port 24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Start _get_guest_xml network_info=[{"id": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "address": "fa:16:3e:ef:95:ba", "network": {"id": "8fb8583c-cd2f-4a58-96b5-8fe7c93535a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-455369873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f383c938a0a44aa994cf1d464f94e34d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24dcb843-59", "ovs_interfaceid": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:52:42Z,direct_url=<?>,disk_format='qcow2',id=dcd48dec-7021-4cfa-bd29-b9c55c2f2cd4,min_disk=0,min_ram=0,name='',owner='d6305e878bc64614a9de6aa6cb6d1251',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:52:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/sda', 'boot_index': 0, 'image_id': 'dcd48dec-7021-4cfa-bd29-b9c55c2f2cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:52:59 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:59 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:52:42Z,direct_url=<?>,disk_format='qcow2',id=dcd48dec-7021-4cfa-bd29-b9c55c2f2cd4,min_disk=0,min_ram=0,name='',owner='d6305e878bc64614a9de6aa6cb6d1251',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:52:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-974676531',display_name='tempest-AttachSCSIVolumeTestJSON-server-974676531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-974676531',id=6,image_ref='dcd48dec-7021-4cfa-bd29-b9c55c2f2cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInRA30WQI2ncmFKQn/oAodzJ60cf3EdPzqx8kJsNZ2szWIrc8JJvcbJLVrZu2ZVnzcUJ+CCma2USfgU8/ECWbQFqS2TqQTaQ85Qpx8I8KHw5+XXPjQUwJ1GSOYLFbNqGg==',key_name='tempest-keypair-205192162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f383c938a0a44aa994cf1d464f94e34d',ramdisk_id='',reservation_id='r-kmb4dy7e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dcd48dec-7021-4cfa-bd29-b9c55c2f2cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-933288876',owner_user_name='tempest-AttachSCSIVolumeTestJSON-933288876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88449d0e7b294376884edb24722bbd39',uuid=ea55b3b9-4821-4400-b99f-ba233c2a7395,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "address": "fa:16:3e:ef:95:ba", "network": {"id": "8fb8583c-cd2f-4a58-96b5-8fe7c93535a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-455369873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f383c938a0a44aa994cf1d464f94e34d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24dcb843-59", "ovs_interfaceid": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Converting VIF {"id": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "address": "fa:16:3e:ef:95:ba", "network": {"id": "8fb8583c-cd2f-4a58-96b5-8fe7c93535a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-455369873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f383c938a0a44aa994cf1d464f94e34d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24dcb843-59", "ovs_interfaceid": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:95:ba,bridge_name='br-int',has_traffic_filtering=True,id=24dcb843-5910-4f0c-bace-e9b24f5536a8,network=Network(8fb8583c-cd2f-4a58-96b5-8fe7c93535a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24dcb843-59') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.objects.instance [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lazy-loading 'pci_devices' on Instance uuid ea55b3b9-4821-4400-b99f-ba233c2a7395 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.185s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:52:59 user nova-compute[70645]:   <uuid>ea55b3b9-4821-4400-b99f-ba233c2a7395</uuid>
Jul 24 14:52:59 user nova-compute[70645]:   <name>instance-00000006</name>
Jul 24 14:52:59 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:52:59 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:52:59 user nova-compute[70645]:   <metadata>
Jul 24 14:52:59 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:52:59 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:52:59 user nova-compute[70645]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-974676531</nova:name>
Jul 24 14:52:59 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:52:59</nova:creationTime>
Jul 24 14:52:59 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:52:59 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:52:59 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:52:59 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:52:59 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:52:59 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:52:59 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:52:59 user nova-compute[70645]:       <nova:owner>
Jul 24 14:52:59 user nova-compute[70645]:         <nova:user uuid="88449d0e7b294376884edb24722bbd39">tempest-AttachSCSIVolumeTestJSON-933288876-project-member</nova:user>
Jul 24 14:52:59 user nova-compute[70645]:         <nova:project uuid="f383c938a0a44aa994cf1d464f94e34d">tempest-AttachSCSIVolumeTestJSON-933288876</nova:project>
Jul 24 14:52:59 user nova-compute[70645]:       </nova:owner>
Jul 24 14:52:59 user nova-compute[70645]:       <nova:root type="image" uuid="dcd48dec-7021-4cfa-bd29-b9c55c2f2cd4"/>
Jul 24 14:52:59 user nova-compute[70645]:       <nova:ports>
Jul 24 14:52:59 user nova-compute[70645]:         <nova:port uuid="24dcb843-5910-4f0c-bace-e9b24f5536a8">
Jul 24 14:52:59 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 14:52:59 user nova-compute[70645]:         </nova:port>
Jul 24 14:52:59 user nova-compute[70645]:       </nova:ports>
Jul 24 14:52:59 user nova-compute[70645]:     </nova:instance>
Jul 24 14:52:59 user nova-compute[70645]:   </metadata>
Jul 24 14:52:59 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:52:59 user nova-compute[70645]:     <system>
Jul 24 14:52:59 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:52:59 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:52:59 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:52:59 user nova-compute[70645]:       <entry name="serial">ea55b3b9-4821-4400-b99f-ba233c2a7395</entry>
Jul 24 14:52:59 user nova-compute[70645]:       <entry name="uuid">ea55b3b9-4821-4400-b99f-ba233c2a7395</entry>
Jul 24 14:52:59 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:52:59 user nova-compute[70645]:     </system>
Jul 24 14:52:59 user nova-compute[70645]:   </sysinfo>
Jul 24 14:52:59 user nova-compute[70645]:   <os>
Jul 24 14:52:59 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:52:59 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:52:59 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:52:59 user nova-compute[70645]:   </os>
Jul 24 14:52:59 user nova-compute[70645]:   <features>
Jul 24 14:52:59 user nova-compute[70645]:     <acpi/>
Jul 24 14:52:59 user nova-compute[70645]:     <apic/>
Jul 24 14:52:59 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:52:59 user nova-compute[70645]:   </features>
Jul 24 14:52:59 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:52:59 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:52:59 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:52:59 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:52:59 user nova-compute[70645]:   </clock>
Jul 24 14:52:59 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:52:59 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:52:59 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:52:59 user nova-compute[70645]:   </cpu>
Jul 24 14:52:59 user nova-compute[70645]:   <devices>
Jul 24 14:52:59 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:52:59 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:52:59 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk"/>
Jul 24 14:52:59 user nova-compute[70645]:       <target dev="sda" bus="scsi"/>
Jul 24 14:52:59 user nova-compute[70645]:       <address type="drive" controller="0" unit="0"/>
Jul 24 14:52:59 user nova-compute[70645]:     </disk>
Jul 24 14:52:59 user nova-compute[70645]:     <disk type="file" device="cdrom">
Jul 24 14:52:59 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 14:52:59 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk.config"/>
Jul 24 14:52:59 user nova-compute[70645]:       <target dev="sdb" bus="scsi"/>
Jul 24 14:52:59 user nova-compute[70645]:       <address type="drive" controller="0" unit="1"/>
Jul 24 14:52:59 user nova-compute[70645]:     </disk>
Jul 24 14:52:59 user nova-compute[70645]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 24 14:52:59 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:52:59 user nova-compute[70645]:       <mac address="fa:16:3e:ef:95:ba"/>
Jul 24 14:52:59 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:59 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:52:59 user nova-compute[70645]:       <target dev="tap24dcb843-59"/>
Jul 24 14:52:59 user nova-compute[70645]:     </interface>
Jul 24 14:52:59 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:52:59 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/console.log" append="off"/>
Jul 24 14:52:59 user nova-compute[70645]:     </serial>
Jul 24 14:52:59 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:52:59 user nova-compute[70645]:     <video>
Jul 24 14:52:59 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:52:59 user nova-compute[70645]:     </video>
Jul 24 14:52:59 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:52:59 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:52:59 user nova-compute[70645]:     </rng>
Jul 24 14:52:59 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:52:59 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:52:59 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:52:59 user nova-compute[70645]:     </memballoon>
Jul 24 14:52:59 user nova-compute[70645]:   </devices>
Jul 24 14:52:59 user nova-compute[70645]: </domain>
Jul 24 14:52:59 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-974676531',display_name='tempest-AttachSCSIVolumeTestJSON-server-974676531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-974676531',id=6,image_ref='dcd48dec-7021-4cfa-bd29-b9c55c2f2cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInRA30WQI2ncmFKQn/oAodzJ60cf3EdPzqx8kJsNZ2szWIrc8JJvcbJLVrZu2ZVnzcUJ+CCma2USfgU8/ECWbQFqS2TqQTaQ85Qpx8I8KHw5+XXPjQUwJ1GSOYLFbNqGg==',key_name='tempest-keypair-205192162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f383c938a0a44aa994cf1d464f94e34d',ramdisk_id='',reservation_id='r-kmb4dy7e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dcd48dec-7021-4cfa-bd29-b9c55c2f2cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-933288876',owner_user_name='tempest-AttachSCSIVolumeTestJSON-933288876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88449d0e7b294376884edb24722bbd39',uuid=ea55b3b9-4821-4400-b99f-ba233c2a7395,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "address": "fa:16:3e:ef:95:ba", "network": {"id": "8fb8583c-cd2f-4a58-96b5-8fe7c93535a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-455369873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f383c938a0a44aa994cf1d464f94e34d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24dcb843-59", "ovs_interfaceid": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Converting VIF {"id": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "address": "fa:16:3e:ef:95:ba", "network": {"id": "8fb8583c-cd2f-4a58-96b5-8fe7c93535a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-455369873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f383c938a0a44aa994cf1d464f94e34d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24dcb843-59", "ovs_interfaceid": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:95:ba,bridge_name='br-int',has_traffic_filtering=True,id=24dcb843-5910-4f0c-bace-e9b24f5536a8,network=Network(8fb8583c-cd2f-4a58-96b5-8fe7c93535a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24dcb843-59') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG os_vif [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:95:ba,bridge_name='br-int',has_traffic_filtering=True,id=24dcb843-5910-4f0c-bace-e9b24f5536a8,network=Network(8fb8583c-cd2f-4a58-96b5-8fe7c93535a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24dcb843-59') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24dcb843-59, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24dcb843-59, col_values=(('external_ids', {'iface-id': '24dcb843-5910-4f0c-bace-e9b24f5536a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:95:ba', 'vm-uuid': 'ea55b3b9-4821-4400-b99f-ba233c2a7395'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:52:59 user nova-compute[70645]: INFO os_vif [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:95:ba,bridge_name='br-int',has_traffic_filtering=True,id=24dcb843-5910-4f0c-bace-e9b24f5536a8,network=Network(8fb8583c-cd2f-4a58-96b5-8fe7c93535a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24dcb843-59')
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] No BDM found with device name sda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] No VIF found with MAC fa:16:3e:ef:95:ba, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:52:59 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Using config drive
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.194s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk 1073741824" returned: 0 in 0.076s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:52:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG nova.compute.manager [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:53:00 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Creating config drive at /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk.config
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprn4fm0md {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Cannot resize image /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lazy-loading 'migration_context' on Instance uuid a816f335-7f2e-4121-9667-237b22349724 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprn4fm0md" returned: 0 in 0.068s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:53:00 user nova-compute[70645]: INFO nova.compute.claims [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Claim successful on node user
Jul 24 14:53:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Ensure instance console log exists: /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.774s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.network.neutron [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:53:01 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.network.neutron [req-1cc1f3c3-6abe-4615-9584-58840b29c9d5 req-99c9b415-c983-431b-92e5-2218e194f95e service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Updated VIF entry in instance network info cache for port 24dcb843-5910-4f0c-bace-e9b24f5536a8. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.network.neutron [req-1cc1f3c3-6abe-4615-9584-58840b29c9d5 req-99c9b415-c983-431b-92e5-2218e194f95e service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Updating instance_info_cache with network_info: [{"id": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "address": "fa:16:3e:ef:95:ba", "network": {"id": "8fb8583c-cd2f-4a58-96b5-8fe7c93535a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-455369873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f383c938a0a44aa994cf1d464f94e34d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24dcb843-59", "ovs_interfaceid": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1cc1f3c3-6abe-4615-9584-58840b29c9d5 req-99c9b415-c983-431b-92e5-2218e194f95e service nova] Releasing lock "refresh_cache-ea55b3b9-4821-4400-b99f-ba233c2a7395" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:53:01 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Creating image(s)
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.policy [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28e6065f28da456b888cc801f7561b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e96ad4dba143709ad8715dea63bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.164s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Successfully created port: ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-17ac7172-1154-41e6-a729-ced52ec2ed69 req-db14f9ba-0998-4673-befb-f3d68175f7ae service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Received event network-vif-plugged-014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-17ac7172-1154-41e6-a729-ced52ec2ed69 req-db14f9ba-0998-4673-befb-f3d68175f7ae service nova] Acquiring lock "f1a667e2-7992-44e4-9500-fa598493e173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-17ac7172-1154-41e6-a729-ced52ec2ed69 req-db14f9ba-0998-4673-befb-f3d68175f7ae service nova] Lock "f1a667e2-7992-44e4-9500-fa598493e173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-17ac7172-1154-41e6-a729-ced52ec2ed69 req-db14f9ba-0998-4673-befb-f3d68175f7ae service nova] Lock "f1a667e2-7992-44e4-9500-fa598493e173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-17ac7172-1154-41e6-a729-ced52ec2ed69 req-db14f9ba-0998-4673-befb-f3d68175f7ae service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] No waiting events found dispatching network-vif-plugged-014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:53:01 user nova-compute[70645]: WARNING nova.compute.manager [req-17ac7172-1154-41e6-a729-ced52ec2ed69 req-db14f9ba-0998-4673-befb-f3d68175f7ae service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Received unexpected event network-vif-plugged-014795b1-c234-4335-acff-79b1fbab054f for instance with vm_state building and task_state spawning.
Jul 24 14:53:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.149s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk 1073741824" returned: 0 in 0.049s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.170s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Cannot resize image /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG nova.objects.instance [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lazy-loading 'migration_context' on Instance uuid 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Ensure instance console log exists: /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG nova.network.neutron [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Successfully created port: bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-8448468c-7283-4b16-b97a-85f61f249eed req-9d0de53a-0a42-45cf-b8b4-ec7548ec1d3a service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8448468c-7283-4b16-b97a-85f61f249eed req-9d0de53a-0a42-45cf-b8b4-ec7548ec1d3a service nova] Acquiring lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8448468c-7283-4b16-b97a-85f61f249eed req-9d0de53a-0a42-45cf-b8b4-ec7548ec1d3a service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8448468c-7283-4b16-b97a-85f61f249eed req-9d0de53a-0a42-45cf-b8b4-ec7548ec1d3a service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-8448468c-7283-4b16-b97a-85f61f249eed req-9d0de53a-0a42-45cf-b8b4-ec7548ec1d3a service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] No waiting events found dispatching network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:53:02 user nova-compute[70645]: WARNING nova.compute.manager [req-8448468c-7283-4b16-b97a-85f61f249eed req-9d0de53a-0a42-45cf-b8b4-ec7548ec1d3a service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received unexpected event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 for instance with vm_state building and task_state spawning.
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Successfully updated port: ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "refresh_cache-a816f335-7f2e-4121-9667-237b22349724" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquired lock "refresh_cache-a816f335-7f2e-4121-9667-237b22349724" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-383d8ea5-aa5e-419a-9468-39213d4aebab req-b7e8d3cc-6dc4-4e9a-b4a5-f42f3f6d1129 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Received event network-changed-ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-383d8ea5-aa5e-419a-9468-39213d4aebab req-b7e8d3cc-6dc4-4e9a-b4a5-f42f3f6d1129 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Refreshing instance network info cache due to event network-changed-ca039191-1724-4ec8-ac6f-0264f8d8c7ff. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-383d8ea5-aa5e-419a-9468-39213d4aebab req-b7e8d3cc-6dc4-4e9a-b4a5-f42f3f6d1129 service nova] Acquiring lock "refresh_cache-a816f335-7f2e-4121-9667-237b22349724" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Updating instance_info_cache with network_info: [{"id": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "address": "fa:16:3e:6a:c6:57", "network": {"id": "757b79f5-32d3-4ac1-8283-6b1ea3b657b1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508181088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e80c8a86e44f3f9d5a84c24675a8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca039191-17", "ovs_interfaceid": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Releasing lock "refresh_cache-a816f335-7f2e-4121-9667-237b22349724" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Instance network_info: |[{"id": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "address": "fa:16:3e:6a:c6:57", "network": {"id": "757b79f5-32d3-4ac1-8283-6b1ea3b657b1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508181088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e80c8a86e44f3f9d5a84c24675a8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca039191-17", "ovs_interfaceid": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-f5a2e9da-0ff7-4ac5-bd52-3e233a95555f req-c385cb42-a479-4447-96c8-72ca7c28b439 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Received event network-vif-plugged-014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f5a2e9da-0ff7-4ac5-bd52-3e233a95555f req-c385cb42-a479-4447-96c8-72ca7c28b439 service nova] Acquiring lock "f1a667e2-7992-44e4-9500-fa598493e173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f5a2e9da-0ff7-4ac5-bd52-3e233a95555f req-c385cb42-a479-4447-96c8-72ca7c28b439 service nova] Lock "f1a667e2-7992-44e4-9500-fa598493e173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f5a2e9da-0ff7-4ac5-bd52-3e233a95555f req-c385cb42-a479-4447-96c8-72ca7c28b439 service nova] Lock "f1a667e2-7992-44e4-9500-fa598493e173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-f5a2e9da-0ff7-4ac5-bd52-3e233a95555f req-c385cb42-a479-4447-96c8-72ca7c28b439 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] No waiting events found dispatching network-vif-plugged-014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:53:03 user nova-compute[70645]: WARNING nova.compute.manager [req-f5a2e9da-0ff7-4ac5-bd52-3e233a95555f req-c385cb42-a479-4447-96c8-72ca7c28b439 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Received unexpected event network-vif-plugged-014795b1-c234-4335-acff-79b1fbab054f for instance with vm_state building and task_state spawning.
Jul 24 14:53:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-383d8ea5-aa5e-419a-9468-39213d4aebab req-b7e8d3cc-6dc4-4e9a-b4a5-f42f3f6d1129 service nova] Acquired lock "refresh_cache-a816f335-7f2e-4121-9667-237b22349724" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.network.neutron [req-383d8ea5-aa5e-419a-9468-39213d4aebab req-b7e8d3cc-6dc4-4e9a-b4a5-f42f3f6d1129 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Refreshing network info cache for port ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Start _get_guest_xml network_info=[{"id": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "address": "fa:16:3e:6a:c6:57", "network": {"id": "757b79f5-32d3-4ac1-8283-6b1ea3b657b1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508181088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e80c8a86e44f3f9d5a84c24675a8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca039191-17", "ovs_interfaceid": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:53:03 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:53:03 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:53:03 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-683612195',display_name='tempest-TestVolumeSwap-server-683612195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-683612195',id=7,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQQ56MbDctncshuOCQq0NQNBIHy0IAktxajEzkJ7Tp7sKS/a7PfwBxREHv6RQ4iZdxloNVc1PsTEYox1dGA5tNPIwRgHeAVS35lRTZ5Q72UE2We3e4zHBaYuF7IW3LWFg==',key_name='tempest-keypair-1085764722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e80c8a86e44f3f9d5a84c24675a8e7',ramdisk_id='',reservation_id='r-lbnkuuya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1001337689',owner_user_name='tempest-TestVolumeSwap-1001337689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8760fdb15c6d4727b2fec40542abe913',uuid=a816f335-7f2e-4121-9667-237b22349724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "address": "fa:16:3e:6a:c6:57", "network": {"id": "757b79f5-32d3-4ac1-8283-6b1ea3b657b1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508181088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e80c8a86e44f3f9d5a84c24675a8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca039191-17", "ovs_interfaceid": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Converting VIF {"id": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "address": "fa:16:3e:6a:c6:57", "network": {"id": "757b79f5-32d3-4ac1-8283-6b1ea3b657b1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508181088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e80c8a86e44f3f9d5a84c24675a8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca039191-17", "ovs_interfaceid": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=ca039191-1724-4ec8-ac6f-0264f8d8c7ff,network=Network(757b79f5-32d3-4ac1-8283-6b1ea3b657b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca039191-17') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lazy-loading 'pci_devices' on Instance uuid a816f335-7f2e-4121-9667-237b22349724 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:53:04 user nova-compute[70645]:   <uuid>a816f335-7f2e-4121-9667-237b22349724</uuid>
Jul 24 14:53:04 user nova-compute[70645]:   <name>instance-00000007</name>
Jul 24 14:53:04 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:53:04 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:53:04 user nova-compute[70645]:   <metadata>
Jul 24 14:53:04 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:53:04 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:53:04 user nova-compute[70645]:       <nova:name>tempest-TestVolumeSwap-server-683612195</nova:name>
Jul 24 14:53:04 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:53:03</nova:creationTime>
Jul 24 14:53:04 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:53:04 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:53:04 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:53:04 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:53:04 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:53:04 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:53:04 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:53:04 user nova-compute[70645]:       <nova:owner>
Jul 24 14:53:04 user nova-compute[70645]:         <nova:user uuid="8760fdb15c6d4727b2fec40542abe913">tempest-TestVolumeSwap-1001337689-project-member</nova:user>
Jul 24 14:53:04 user nova-compute[70645]:         <nova:project uuid="d5e80c8a86e44f3f9d5a84c24675a8e7">tempest-TestVolumeSwap-1001337689</nova:project>
Jul 24 14:53:04 user nova-compute[70645]:       </nova:owner>
Jul 24 14:53:04 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:53:04 user nova-compute[70645]:       <nova:ports>
Jul 24 14:53:04 user nova-compute[70645]:         <nova:port uuid="ca039191-1724-4ec8-ac6f-0264f8d8c7ff">
Jul 24 14:53:04 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 14:53:04 user nova-compute[70645]:         </nova:port>
Jul 24 14:53:04 user nova-compute[70645]:       </nova:ports>
Jul 24 14:53:04 user nova-compute[70645]:     </nova:instance>
Jul 24 14:53:04 user nova-compute[70645]:   </metadata>
Jul 24 14:53:04 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:53:04 user nova-compute[70645]:     <system>
Jul 24 14:53:04 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:53:04 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:53:04 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:53:04 user nova-compute[70645]:       <entry name="serial">a816f335-7f2e-4121-9667-237b22349724</entry>
Jul 24 14:53:04 user nova-compute[70645]:       <entry name="uuid">a816f335-7f2e-4121-9667-237b22349724</entry>
Jul 24 14:53:04 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:53:04 user nova-compute[70645]:     </system>
Jul 24 14:53:04 user nova-compute[70645]:   </sysinfo>
Jul 24 14:53:04 user nova-compute[70645]:   <os>
Jul 24 14:53:04 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:53:04 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:53:04 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:53:04 user nova-compute[70645]:   </os>
Jul 24 14:53:04 user nova-compute[70645]:   <features>
Jul 24 14:53:04 user nova-compute[70645]:     <acpi/>
Jul 24 14:53:04 user nova-compute[70645]:     <apic/>
Jul 24 14:53:04 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:53:04 user nova-compute[70645]:   </features>
Jul 24 14:53:04 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:53:04 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:53:04 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:53:04 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:53:04 user nova-compute[70645]:   </clock>
Jul 24 14:53:04 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:53:04 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:53:04 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:53:04 user nova-compute[70645]:   </cpu>
Jul 24 14:53:04 user nova-compute[70645]:   <devices>
Jul 24 14:53:04 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:53:04 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:53:04 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk"/>
Jul 24 14:53:04 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:53:04 user nova-compute[70645]:     </disk>
Jul 24 14:53:04 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:53:04 user nova-compute[70645]:       <mac address="fa:16:3e:6a:c6:57"/>
Jul 24 14:53:04 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:53:04 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:53:04 user nova-compute[70645]:       <target dev="tapca039191-17"/>
Jul 24 14:53:04 user nova-compute[70645]:     </interface>
Jul 24 14:53:04 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:53:04 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/console.log" append="off"/>
Jul 24 14:53:04 user nova-compute[70645]:     </serial>
Jul 24 14:53:04 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:53:04 user nova-compute[70645]:     <video>
Jul 24 14:53:04 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:53:04 user nova-compute[70645]:     </video>
Jul 24 14:53:04 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:53:04 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:53:04 user nova-compute[70645]:     </rng>
Jul 24 14:53:04 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:53:04 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:53:04 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:53:04 user nova-compute[70645]:     </memballoon>
Jul 24 14:53:04 user nova-compute[70645]:   </devices>
Jul 24 14:53:04 user nova-compute[70645]: </domain>
Jul 24 14:53:04 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-683612195',display_name='tempest-TestVolumeSwap-server-683612195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-683612195',id=7,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQQ56MbDctncshuOCQq0NQNBIHy0IAktxajEzkJ7Tp7sKS/a7PfwBxREHv6RQ4iZdxloNVc1PsTEYox1dGA5tNPIwRgHeAVS35lRTZ5Q72UE2We3e4zHBaYuF7IW3LWFg==',key_name='tempest-keypair-1085764722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e80c8a86e44f3f9d5a84c24675a8e7',ramdisk_id='',reservation_id='r-lbnkuuya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1001337689',owner_user_name='tempest-TestVolumeSwap-1001337689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:52:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8760fdb15c6d4727b2fec40542abe913',uuid=a816f335-7f2e-4121-9667-237b22349724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "address": "fa:16:3e:6a:c6:57", "network": {"id": "757b79f5-32d3-4ac1-8283-6b1ea3b657b1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508181088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e80c8a86e44f3f9d5a84c24675a8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca039191-17", "ovs_interfaceid": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Converting VIF {"id": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "address": "fa:16:3e:6a:c6:57", "network": {"id": "757b79f5-32d3-4ac1-8283-6b1ea3b657b1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508181088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e80c8a86e44f3f9d5a84c24675a8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca039191-17", "ovs_interfaceid": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=ca039191-1724-4ec8-ac6f-0264f8d8c7ff,network=Network(757b79f5-32d3-4ac1-8283-6b1ea3b657b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca039191-17') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG os_vif [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=ca039191-1724-4ec8-ac6f-0264f8d8c7ff,network=Network(757b79f5-32d3-4ac1-8283-6b1ea3b657b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca039191-17') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca039191-17, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca039191-17, col_values=(('external_ids', {'iface-id': 'ca039191-1724-4ec8-ac6f-0264f8d8c7ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:c6:57', 'vm-uuid': 'a816f335-7f2e-4121-9667-237b22349724'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:04 user nova-compute[70645]: INFO os_vif [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=ca039191-1724-4ec8-ac6f-0264f8d8c7ff,network=Network(757b79f5-32d3-4ac1-8283-6b1ea3b657b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca039191-17')
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] No VIF found with MAC fa:16:3e:6a:c6:57, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.neutron [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Successfully updated port: bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquired lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.neutron [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.neutron [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.neutron [req-383d8ea5-aa5e-419a-9468-39213d4aebab req-b7e8d3cc-6dc4-4e9a-b4a5-f42f3f6d1129 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Updated VIF entry in instance network info cache for port ca039191-1724-4ec8-ac6f-0264f8d8c7ff. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.neutron [req-383d8ea5-aa5e-419a-9468-39213d4aebab req-b7e8d3cc-6dc4-4e9a-b4a5-f42f3f6d1129 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Updating instance_info_cache with network_info: [{"id": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "address": "fa:16:3e:6a:c6:57", "network": {"id": "757b79f5-32d3-4ac1-8283-6b1ea3b657b1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508181088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e80c8a86e44f3f9d5a84c24675a8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca039191-17", "ovs_interfaceid": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-383d8ea5-aa5e-419a-9468-39213d4aebab req-b7e8d3cc-6dc4-4e9a-b4a5-f42f3f6d1129 service nova] Releasing lock "refresh_cache-a816f335-7f2e-4121-9667-237b22349724" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.neutron [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updating instance_info_cache with network_info: [{"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Releasing lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Instance network_info: |[{"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Start _get_guest_xml network_info=[{"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:53:04 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:53:04 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-896493417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-896493417',id=8,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOC+pbtS3b10zgGPN8jzEAGTj3Lutj6NjqD/u3q2th61GdXcNYKMiu+ZkghxLk9jByTpKK5pKCNa5736mrWQiHDLOInWyMhYDKqT7SxK/aJuuMMC5WiwiwkOIdnj15Mqg==',key_name='tempest-keypair-1737242635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e96ad4dba143709ad8715dea63bf23',ramdisk_id='',reservation_id='r-wle60jho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-813130247',owner_user_name='tempest-TaggedAttachmentsTest-813130247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28e6065f28da456b888cc801f7561b85',uuid=5f355cfc-9d1b-4f2b-936b-e28a65bd99e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converting VIF {"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d0:25,bridge_name='br-int',has_traffic_filtering=True,id=bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1,network=Network(052eebd2-fa35-4f82-a9d0-1261feeffd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe5f4a4-6a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:53:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:53:05 user nova-compute[70645]:   <uuid>5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</uuid>
Jul 24 14:53:05 user nova-compute[70645]:   <name>instance-00000008</name>
Jul 24 14:53:05 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:53:05 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:53:05 user nova-compute[70645]:   <metadata>
Jul 24 14:53:05 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:53:05 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:53:05 user nova-compute[70645]:       <nova:name>tempest-device-tagging-server-896493417</nova:name>
Jul 24 14:53:05 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:53:04</nova:creationTime>
Jul 24 14:53:05 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:53:05 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:53:05 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:53:05 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:53:05 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:53:05 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:53:05 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:53:05 user nova-compute[70645]:       <nova:owner>
Jul 24 14:53:05 user nova-compute[70645]:         <nova:user uuid="28e6065f28da456b888cc801f7561b85">tempest-TaggedAttachmentsTest-813130247-project-member</nova:user>
Jul 24 14:53:05 user nova-compute[70645]:         <nova:project uuid="b7e96ad4dba143709ad8715dea63bf23">tempest-TaggedAttachmentsTest-813130247</nova:project>
Jul 24 14:53:05 user nova-compute[70645]:       </nova:owner>
Jul 24 14:53:05 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:53:05 user nova-compute[70645]:       <nova:ports>
Jul 24 14:53:05 user nova-compute[70645]:         <nova:port uuid="bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1">
Jul 24 14:53:05 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 14:53:05 user nova-compute[70645]:         </nova:port>
Jul 24 14:53:05 user nova-compute[70645]:       </nova:ports>
Jul 24 14:53:05 user nova-compute[70645]:     </nova:instance>
Jul 24 14:53:05 user nova-compute[70645]:   </metadata>
Jul 24 14:53:05 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:53:05 user nova-compute[70645]:     <system>
Jul 24 14:53:05 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:53:05 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:53:05 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:53:05 user nova-compute[70645]:       <entry name="serial">5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</entry>
Jul 24 14:53:05 user nova-compute[70645]:       <entry name="uuid">5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</entry>
Jul 24 14:53:05 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:53:05 user nova-compute[70645]:     </system>
Jul 24 14:53:05 user nova-compute[70645]:   </sysinfo>
Jul 24 14:53:05 user nova-compute[70645]:   <os>
Jul 24 14:53:05 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:53:05 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:53:05 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:53:05 user nova-compute[70645]:   </os>
Jul 24 14:53:05 user nova-compute[70645]:   <features>
Jul 24 14:53:05 user nova-compute[70645]:     <acpi/>
Jul 24 14:53:05 user nova-compute[70645]:     <apic/>
Jul 24 14:53:05 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:53:05 user nova-compute[70645]:   </features>
Jul 24 14:53:05 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:53:05 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:53:05 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:53:05 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:53:05 user nova-compute[70645]:   </clock>
Jul 24 14:53:05 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:53:05 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:53:05 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:53:05 user nova-compute[70645]:   </cpu>
Jul 24 14:53:05 user nova-compute[70645]:   <devices>
Jul 24 14:53:05 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:53:05 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:53:05 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk"/>
Jul 24 14:53:05 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:53:05 user nova-compute[70645]:     </disk>
Jul 24 14:53:05 user nova-compute[70645]:     <disk type="file" device="cdrom">
Jul 24 14:53:05 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 14:53:05 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk.config"/>
Jul 24 14:53:05 user nova-compute[70645]:       <target dev="hda" bus="ide"/>
Jul 24 14:53:05 user nova-compute[70645]:     </disk>
Jul 24 14:53:05 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:53:05 user nova-compute[70645]:       <mac address="fa:16:3e:32:d0:25"/>
Jul 24 14:53:05 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:53:05 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:53:05 user nova-compute[70645]:       <target dev="tapbfe5f4a4-6a"/>
Jul 24 14:53:05 user nova-compute[70645]:     </interface>
Jul 24 14:53:05 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:53:05 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/console.log" append="off"/>
Jul 24 14:53:05 user nova-compute[70645]:     </serial>
Jul 24 14:53:05 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:53:05 user nova-compute[70645]:     <video>
Jul 24 14:53:05 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:53:05 user nova-compute[70645]:     </video>
Jul 24 14:53:05 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:53:05 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:53:05 user nova-compute[70645]:     </rng>
Jul 24 14:53:05 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:53:05 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:53:05 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:53:05 user nova-compute[70645]:     </memballoon>
Jul 24 14:53:05 user nova-compute[70645]:   </devices>
Jul 24 14:53:05 user nova-compute[70645]: </domain>
Jul 24 14:53:05 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-896493417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-896493417',id=8,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOC+pbtS3b10zgGPN8jzEAGTj3Lutj6NjqD/u3q2th61GdXcNYKMiu+ZkghxLk9jByTpKK5pKCNa5736mrWQiHDLOInWyMhYDKqT7SxK/aJuuMMC5WiwiwkOIdnj15Mqg==',key_name='tempest-keypair-1737242635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e96ad4dba143709ad8715dea63bf23',ramdisk_id='',reservation_id='r-wle60jho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-813130247',owner_user_name='tempest-TaggedAttachmentsTest-813130247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28e6065f28da456b888cc801f7561b85',uuid=5f355cfc-9d1b-4f2b-936b-e28a65bd99e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converting VIF {"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d0:25,bridge_name='br-int',has_traffic_filtering=True,id=bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1,network=Network(052eebd2-fa35-4f82-a9d0-1261feeffd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe5f4a4-6a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG os_vif [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d0:25,bridge_name='br-int',has_traffic_filtering=True,id=bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1,network=Network(052eebd2-fa35-4f82-a9d0-1261feeffd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe5f4a4-6a') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfe5f4a4-6a, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbfe5f4a4-6a, col_values=(('external_ids', {'iface-id': 'bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:d0:25', 'vm-uuid': '5f355cfc-9d1b-4f2b-936b-e28a65bd99e1'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] Acquiring lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] No waiting events found dispatching network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:53:05 user nova-compute[70645]: WARNING nova.compute.manager [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received unexpected event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 for instance with vm_state building and task_state spawning.
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-changed-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Refreshing instance network info cache due to event network-changed-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] Acquiring lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] Acquired lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.network.neutron [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Refreshing network info cache for port bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:05 user nova-compute[70645]: INFO os_vif [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d0:25,bridge_name='br-int',has_traffic_filtering=True,id=bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1,network=Network(052eebd2-fa35-4f82-a9d0-1261feeffd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe5f4a4-6a')
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Received event network-vif-plugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] Acquiring lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] No waiting events found dispatching network-vif-plugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:53:05 user nova-compute[70645]: WARNING nova.compute.manager [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Received unexpected event network-vif-plugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 for instance with vm_state building and task_state spawning.
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Received event network-vif-plugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] Acquiring lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] No waiting events found dispatching network-vif-plugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:53:05 user nova-compute[70645]: WARNING nova.compute.manager [req-5700d5da-7c85-4fe0-866b-9dc7e5f6fd90 req-f3be2f90-250a-4277-b60d-7ffa27259364 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Received unexpected event network-vif-plugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 for instance with vm_state building and task_state spawning.
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] No BDM found with device name hda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] No VIF found with MAC fa:16:3e:32:d0:25, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:53:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Using config drive
Jul 24 14:53:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Creating config drive at /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk.config
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdvoxbg8v {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdvoxbg8v" returned: 0 in 0.060s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210385.6692188, f1a667e2-7992-44e4-9500-fa598493e173 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:53:05 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] VM Resumed (Lifecycle Event)
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:53:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Instance spawned successfully.
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.network.neutron [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updated VIF entry in instance network info cache for port bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.network.neutron [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updating instance_info_cache with network_info: [{"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:05 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210385.676095, f1a667e2-7992-44e4-9500-fa598493e173 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:53:05 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] VM Started (Lifecycle Event)
Jul 24 14:53:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9690f6e4-79e8-46b8-8e70-b0aeff508058 req-cc4d1aa0-66c5-4715-a4f3-9904bfed8091 service nova] Releasing lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:53:05 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Took 13.31 seconds to spawn the instance on the hypervisor.
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210386.1440418, 07268543-d6a3-479b-a4b9-e0cc87bb068a => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] VM Resumed (Lifecycle Event)
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Took 14.40 seconds to build instance.
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-684df488-29e4-42fd-9e4a-aa35e5b1ed16 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.582s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Instance spawned successfully.
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210386.1540232, 07268543-d6a3-479b-a4b9-e0cc87bb068a => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] VM Started (Lifecycle Event)
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Instance spawned successfully.
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210386.3088517, ea55b3b9-4821-4400-b99f-ba233c2a7395 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] VM Resumed (Lifecycle Event)
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Took 12.65 seconds to spawn the instance on the hypervisor.
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210386.3168688, ea55b3b9-4821-4400-b99f-ba233c2a7395 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] VM Started (Lifecycle Event)
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Took 11.36 seconds to spawn the instance on the hypervisor.
Jul 24 14:53:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Took 14.61 seconds to build instance.
Jul 24 14:53:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-774c1367-5ea9-43e7-ae4f-440a2e7627a3 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.773s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:06 user nova-compute[70645]: INFO nova.compute.manager [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Took 12.65 seconds to build instance.
Jul 24 14:53:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-442765c2-49f6-4132-868d-d754ec535948 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.935s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Received event network-vif-plugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] Lock "a816f335-7f2e-4121-9667-237b22349724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] Lock "a816f335-7f2e-4121-9667-237b22349724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] No waiting events found dispatching network-vif-plugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:53:07 user nova-compute[70645]: WARNING nova.compute.manager [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Received unexpected event network-vif-plugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff for instance with vm_state building and task_state spawning.
Jul 24 14:53:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Received event network-vif-plugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] Lock "a816f335-7f2e-4121-9667-237b22349724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] Lock "a816f335-7f2e-4121-9667-237b22349724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] No waiting events found dispatching network-vif-plugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:53:07 user nova-compute[70645]: WARNING nova.compute.manager [req-660cc8d8-9fc3-455e-b186-a7cf165043f1 req-32ea4f42-c663-4afc-a037-0638a4b10135 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Received unexpected event network-vif-plugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff for instance with vm_state building and task_state spawning.
Jul 24 14:53:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG nova.compute.manager [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-vif-plugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG nova.compute.manager [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] No waiting events found dispatching network-vif-plugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:53:09 user nova-compute[70645]: WARNING nova.compute.manager [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received unexpected event network-vif-plugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 for instance with vm_state building and task_state spawning.
Jul 24 14:53:09 user nova-compute[70645]: DEBUG nova.compute.manager [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-vif-plugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG nova.compute.manager [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] No waiting events found dispatching network-vif-plugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:53:09 user nova-compute[70645]: WARNING nova.compute.manager [req-8b405e77-4cd4-4ce2-a621-2f0eb2507e1e req-918e29b0-9a00-430b-9adb-1aceb8400a21 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received unexpected event network-vif-plugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 for instance with vm_state building and task_state spawning.
Jul 24 14:53:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] There are 0 instances to clean {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70645) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 14:53:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:10 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210390.9928515, a816f335-7f2e-4121-9667-237b22349724 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:53:10 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: a816f335-7f2e-4121-9667-237b22349724] VM Resumed (Lifecycle Event)
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: a816f335-7f2e-4121-9667-237b22349724] Instance spawned successfully.
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: a816f335-7f2e-4121-9667-237b22349724] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: a816f335-7f2e-4121-9667-237b22349724] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: a816f335-7f2e-4121-9667-237b22349724] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210391.008023, a816f335-7f2e-4121-9667-237b22349724 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: a816f335-7f2e-4121-9667-237b22349724] VM Started (Lifecycle Event)
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: a816f335-7f2e-4121-9667-237b22349724] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: a816f335-7f2e-4121-9667-237b22349724] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: a816f335-7f2e-4121-9667-237b22349724] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210391.1596932, 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] VM Resumed (Lifecycle Event)
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Instance spawned successfully.
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.compute.manager [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Took 11.78 seconds to spawn the instance on the hypervisor.
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210391.1610134, 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] VM Started (Lifecycle Event)
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.compute.manager [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Took 9.83 seconds to spawn the instance on the hypervisor.
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.compute.manager [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Took 11.18 seconds to build instance.
Jul 24 14:53:11 user nova-compute[70645]: INFO nova.compute.manager [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Took 12.62 seconds to build instance.
Jul 24 14:53:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-15b4ae8e-cb81-4723-af12-47dfda68969e tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.432s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b80afc1-c985-42fa-a36c-e98de1126202 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.772s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:12 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 14:53:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:12 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:53:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:16 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:53:16 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:53:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8001MB free_disk=25.93451690673828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:53:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 046adfbd-fa5f-45f5-ae62-ddc0f834d450 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance f1a667e2-7992-44e4-9500-fa598493e173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 07268543-d6a3-479b-a4b9-e0cc87bb068a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance ea55b3b9-4821-4400-b99f-ba233c2a7395 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance a816f335-7f2e-4121-9667-237b22349724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:53:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 14:53:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 14:53:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 14:53:18 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid b13c0261-b25c-48ce-9245-fa43dadc1829 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:53:19 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Updating instance_info_cache with network_info: [{"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 14:53:19 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:19 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:19 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:53:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:53:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:53:42 user nova-compute[70645]: INFO nova.compute.claims [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Claim successful on node user
Jul 24 14:53:42 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Refreshing inventories for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 14:53:42 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Updating ProviderTree inventory for provider a0cf5b80-69d2-4191-894e-a498eab7d688 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 14:53:42 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 14:53:42 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Refreshing aggregate associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, aggregates: None {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 14:53:42 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Refreshing trait associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 14:53:43 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:53:43 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:53:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:53:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:53:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:53:43 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:53:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:53:43 user nova-compute[70645]: INFO nova.virt.block_device [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Booting with volume e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 at /dev/vda
Jul 24 14:53:43 user nova-compute[70645]: DEBUG os_brick.utils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:53:43 user nova-compute[70645]: INFO oslo.privsep.daemon [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp4emgbdrf/privsep.sock']
Jul 24 14:53:43 user sudo[81506]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp4emgbdrf/privsep.sock
Jul 24 14:53:43 user sudo[81506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 24 14:53:43 user nova-compute[70645]: DEBUG nova.policy [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8623aa5d4d1442bfb72081293363fb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374ec2672f3b4469aca169a69c153520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:53:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully created port: 6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "2518724a-a4f8-44e6-8820-1019289e65fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:44 user nova-compute[70645]: DEBUG nova.compute.manager [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:53:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:53:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:53:44 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:53:44 user nova-compute[70645]: INFO nova.compute.claims [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Claim successful on node user
Jul 24 14:53:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully created port: a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:53:45 user sudo[81506]: pam_unix(sudo:session): session closed for user root
Jul 24 14:53:45 user nova-compute[70645]: INFO oslo.privsep.daemon [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Spawned new privsep daemon via rootwrap
Jul 24 14:53:45 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 24 14:53:45 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 24 14:53:45 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 24 14:53:45 user nova-compute[70645]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81509
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea484b3-ca5e-4559-8d2e-fe545e16bb62]: (2,) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:53:45 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:53:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d31baf6-73e5-4afa-a53c-77556356a3c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:45 user nova-compute[70645]: WARNING os_brick.initiator.connectors.nvmeof [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:45 user nova-compute[70645]: INFO nova.virt.block_device [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Booting with volume 484b7324-9c66-458e-9fb0-94c5bc0871d4 at /dev/vda
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e06291-1114-44e6-949c-9cf9d28ca0cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fe2e8c-bec8-483b-b378-104195bb6fe8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[474922bf-1a88-4c24-a90e-36089d67c210]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG os_brick.utils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully created port: cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[98981a93-5626-4c88-8212-2dacc4a878ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG nova.policy [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c77c805d8534d58b109c9dce509378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee83177e9c46e8a6b0579b93a33625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:53:45 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f94161-2166-445d-bf7d-dbe0c47ed1ba]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG os_brick.utils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] <== get_connector_properties: return (2143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating existing volume attachment record: 1ea84107-20f2-4b2e-82d6-908d311e1bd1 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2d43b6-2223-4b30-ad8a-e07ecc7e1c63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b36761-e444-4840-8fc8-5b2a7809427c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6bdfbf-4318-4c08-bf23-6338a5e958a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:53:45 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:53:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[223ddcc9-6c56-4096-a519-d68c63b3f651]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG os_brick.utils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:53:45 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating existing volume attachment record: 3eb8f409-56ed-487a-a202-7f038d553e33 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:53:46 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully created port: 770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:46 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully created port: e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:46 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully created port: cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:46 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully created port: 0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:47 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully created port: be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:47 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully updated port: 6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-c61f3616-3267-4cfd-96a2-318f11d295c1 req-3ad84aaf-40cf-46a1-9252-9d644ff2aa21 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-changed-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-c61f3616-3267-4cfd-96a2-318f11d295c1 req-3ad84aaf-40cf-46a1-9252-9d644ff2aa21 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing instance network info cache due to event network-changed-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c61f3616-3267-4cfd-96a2-318f11d295c1 req-3ad84aaf-40cf-46a1-9252-9d644ff2aa21 service nova] Acquiring lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c61f3616-3267-4cfd-96a2-318f11d295c1 req-3ad84aaf-40cf-46a1-9252-9d644ff2aa21 service nova] Acquired lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-c61f3616-3267-4cfd-96a2-318f11d295c1 req-3ad84aaf-40cf-46a1-9252-9d644ff2aa21 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing network info cache for port 6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:48 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully created port: 76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:48 user nova-compute[70645]: DEBUG nova.network.neutron [req-c61f3616-3267-4cfd-96a2-318f11d295c1 req-3ad84aaf-40cf-46a1-9252-9d644ff2aa21 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:48 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully updated port: db1a0d8c-19bf-4a1e-b526-7261733683c9 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:48 user nova-compute[70645]: DEBUG nova.network.neutron [req-c61f3616-3267-4cfd-96a2-318f11d295c1 req-3ad84aaf-40cf-46a1-9252-9d644ff2aa21 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c61f3616-3267-4cfd-96a2-318f11d295c1 req-3ad84aaf-40cf-46a1-9252-9d644ff2aa21 service nova] Releasing lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:49 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully created port: 0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:53:49 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully updated port: d1022a74-2c30-4f91-b050-85f97db29e4d {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-changed-db1a0d8c-19bf-4a1e-b526-7261733683c9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing instance network info cache due to event network-changed-db1a0d8c-19bf-4a1e-b526-7261733683c9. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] Acquiring lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] Acquired lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing network info cache for port db1a0d8c-19bf-4a1e-b526-7261733683c9 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully updated port: 770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-9ad44ace-de6c-4dde-8c55-23f1f6fc5e73 req-544f03fc-dc5f-4167-b509-a32e3084f5a8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-changed-770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-9ad44ace-de6c-4dde-8c55-23f1f6fc5e73 req-544f03fc-dc5f-4167-b509-a32e3084f5a8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing instance network info cache due to event network-changed-770c4d59-3054-4195-94cf-facdbc1d5ca7. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9ad44ace-de6c-4dde-8c55-23f1f6fc5e73 req-544f03fc-dc5f-4167-b509-a32e3084f5a8 service nova] Acquiring lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9ad44ace-de6c-4dde-8c55-23f1f6fc5e73 req-544f03fc-dc5f-4167-b509-a32e3084f5a8 service nova] Acquired lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-9ad44ace-de6c-4dde-8c55-23f1f6fc5e73 req-544f03fc-dc5f-4167-b509-a32e3084f5a8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing network info cache for port 770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] Releasing lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-changed-d1022a74-2c30-4f91-b050-85f97db29e4d {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing instance network info cache due to event network-changed-d1022a74-2c30-4f91-b050-85f97db29e4d. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] Acquiring lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] Acquired lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing network info cache for port d1022a74-2c30-4f91-b050-85f97db29e4d {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-9ad44ace-de6c-4dde-8c55-23f1f6fc5e73 req-544f03fc-dc5f-4167-b509-a32e3084f5a8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully updated port: a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-9ad44ace-de6c-4dde-8c55-23f1f6fc5e73 req-544f03fc-dc5f-4167-b509-a32e3084f5a8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9ad44ace-de6c-4dde-8c55-23f1f6fc5e73 req-544f03fc-dc5f-4167-b509-a32e3084f5a8 service nova] Releasing lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c8f318b8-b3be-4e68-8810-0d21cf3b1ced req-e63e32bb-f53c-40a7-b921-e78d5c9d8e0e service nova] Releasing lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:51 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully updated port: cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:51 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully updated port: 686c5c08-20e1-482b-96c2-30a6e4e99203 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully updated port: e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-changed-a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing instance network info cache due to event network-changed-a36dd022-bb0f-4848-8fbf-f5c4fb84179c. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] Acquiring lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] Acquired lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing network info cache for port a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully updated port: b6f5ddb9-961a-4001-9d43-740bc19cda82 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-changed-686c5c08-20e1-482b-96c2-30a6e4e99203 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing instance network info cache due to event network-changed-686c5c08-20e1-482b-96c2-30a6e4e99203. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] Acquiring lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] Acquired lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing network info cache for port 686c5c08-20e1-482b-96c2-30a6e4e99203 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Successfully updated port: 0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] Releasing lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-changed-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing instance network info cache due to event network-changed-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] Acquiring lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] Acquired lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing network info cache for port cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] Releasing lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-changed-b6f5ddb9-961a-4001-9d43-740bc19cda82 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing instance network info cache due to event network-changed-b6f5ddb9-961a-4001-9d43-740bc19cda82. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] Acquiring lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] Acquired lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing network info cache for port b6f5ddb9-961a-4001-9d43-740bc19cda82 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:53 user nova-compute[70645]: DEBUG nova.network.neutron [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:53 user nova-compute[70645]: DEBUG nova.network.neutron [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:53 user nova-compute[70645]: DEBUG nova.network.neutron [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-758f4537-6c83-443a-8904-332ccdee161d req-406b3766-48e6-478a-9580-f043f7235b13 service nova] Releasing lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquired lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:53:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3fe46770-dd33-471e-8f18-fee0a96e77d1 req-fc20344f-53c5-4689-8920-c9efe269de4f service nova] Releasing lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully updated port: cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-changed-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing instance network info cache due to event network-changed-e2a1f009-ae21-459d-ae50-8b3b6fb3d545. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] Acquiring lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully updated port: be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-changed-cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing instance network info cache due to event network-changed-cabd5e47-5488-47f2-a96e-92de070a8267. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] Acquiring lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] Acquired lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:54 user nova-compute[70645]: DEBUG nova.network.neutron [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing network info cache for port cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:54 user nova-compute[70645]: DEBUG nova.network.neutron [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] Releasing lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-changed-be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing instance network info cache due to event network-changed-be328240-94a4-416a-97d7-e379d07e2e64. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] Acquiring lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] Acquired lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing network info cache for port be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully updated port: 76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [{"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Releasing lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Instance network_info: |[{"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] Acquired lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing network info cache for port e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d7a49371-e97b-4a03-a0b0-c9ee1bf90e19 req-d3bef9de-c955-4a3a-ba25-d285c79ac1ce service nova] Releasing lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:55 user nova-compute[70645]: INFO nova.virt.block_device [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Booting with volume 06c9e837-c0a9-4f8d-971d-6574c794f321 at /dev/vdb
Jul 24 14:53:55 user nova-compute[70645]: DEBUG os_brick.utils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddac51cd-81b4-4af9-8267-bf8acf856c6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83f7b65-4f94-4fed-a555-c0ffa9458115]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updated VIF entry in instance network info cache for port e2a1f009-ae21-459d-ae50-8b3b6fb3d545. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [{"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[180ec03b-7d52-4b0d-ba24-6a191aa22cb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d795357e-6e0e-47ba-a9b6-e6ce7780f2c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] Releasing lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-changed-0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing instance network info cache due to event network-changed-0204e20d-6b04-425c-9141-236a993c3d98. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] Acquiring lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] Acquired lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing network info cache for port 0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:53:55 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:53:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[325281c4-5f2a-47c0-b90e-0a93b727e262]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG os_brick.utils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:53:55 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating existing volume attachment record: e4576176-c34d-4419-be46-3862291d3d9d {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:53:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Successfully updated port: 0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:53:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquired lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:53:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:53:56 user nova-compute[70645]: DEBUG nova.network.neutron [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updated VIF entry in instance network info cache for port 0204e20d-6b04-425c-9141-236a993c3d98. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:53:56 user nova-compute[70645]: DEBUG nova.network.neutron [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [{"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-42cb7527-f356-4f69-ae3e-49a15114bbf2 req-bbc28eb7-e563-44d0-8208-dd177dd458a6 service nova] Releasing lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:56 user nova-compute[70645]: DEBUG nova.compute.manager [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-changed-76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:56 user nova-compute[70645]: DEBUG nova.compute.manager [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing instance network info cache due to event network-changed-76732353-b1bb-426d-ab39-0ccbefcef0a3. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] Acquiring lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [{"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Releasing lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Instance network_info: |[{"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] Acquired lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG nova.network.neutron [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing network info cache for port 76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG nova.network.neutron [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updated VIF entry in instance network info cache for port 76732353-b1bb-426d-ab39-0ccbefcef0a3. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG nova.network.neutron [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [{"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] Releasing lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG nova.compute.manager [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-changed-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG nova.compute.manager [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing instance network info cache due to event network-changed-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] Acquiring lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] Acquired lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:53:58 user nova-compute[70645]: DEBUG nova.network.neutron [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing network info cache for port 0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:53:59 user nova-compute[70645]: INFO nova.virt.block_device [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Booting with volume c02ec91b-9962-41a2-8ffa-d64bf810057f at /dev/vdb
Jul 24 14:53:59 user nova-compute[70645]: DEBUG os_brick.utils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c18d101-fcd8-4215-a35c-a39a5adbb0bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2ba6ff-493d-4deb-84e7-f47fa089ec7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[21be601d-c1b4-49c1-9722-631bdbe7d58f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee2ac75-67f7-4efc-bd22-599ac650bdde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:53:59 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c02c619-3f3d-45e2-8290-d5aec744d588]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG os_brick.utils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating existing volume attachment record: 9a405d5c-a423-41bd-a75b-39f0e5b2c0b4 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG nova.network.neutron [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updated VIF entry in instance network info cache for port 0a5e5bdf-2fab-444f-ae3a-8cd841b013e9. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG nova.network.neutron [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [{"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:53:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fb2a4646-d30f-4354-8dc8-7dc53d897f8d req-2fcc6c66-bee2-4659-bfdb-d3a780edf9d8 service nova] Releasing lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:54:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 14:54:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 14:54:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 14:54:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:08 user nova-compute[70645]: INFO nova.virt.block_device [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Booting with volume 3f1d687d-8f99-4341-8f13-70659cca8c92 at /dev/vdc
Jul 24 14:54:08 user nova-compute[70645]: DEBUG os_brick.utils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f279f441-e8b7-4f0b-9ef9-654e70ca2914]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b228ebac-22e5-413e-b1ad-109bf6fe680c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[472a6b3d-41a9-4f8b-987a-82c548e9f89f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d523633b-f352-46b3-b7b2-f7af1b2c03b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:08 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:54:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[27084b4e-759c-4a9b-be82-fcd281474c51]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG os_brick.utils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating existing volume attachment record: c40b781c-e8ee-4751-bfcf-946d4659a352 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:54:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:10 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:54:10 user nova-compute[70645]: INFO nova.compute.manager [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] instance snapshotting
Jul 24 14:54:10 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Beginning live snapshot process
Jul 24 14:54:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json -f qcow2 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json -f qcow2 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.162s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp20ft664i/a80d69795951480588f57dbf266ea52c.delta 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp20ft664i/a80d69795951480588f57dbf266ea52c.delta 1073741824" returned: 0 in 0.047s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 14:54:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Checking UEFI support for host arch (x86_64) {{(pid=70645) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 24 14:54:11 user nova-compute[70645]: INFO nova.virt.libvirt.host [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] UEFI support detected
Jul 24 14:54:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:54:12 user nova-compute[70645]: INFO nova.virt.block_device [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Booting with volume 59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 at /dev/vdc
Jul 24 14:54:12 user nova-compute[70645]: DEBUG os_brick.utils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[028c26b9-79a1-4593-927a-c02e2165fafa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1cea8d-2528-42a4-802d-ef0883f5ec7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20fe682-e9e6-46c7-94d8-6dc166b795d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecee197a-d2ee-4d24-90a8-aa5a4ea179e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:12 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5b2033-ad68-4571-b983-bfc2969b838a]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG os_brick.utils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating existing volume attachment record: 3afb05f4-0f34-4178-821c-fd67ba3d0660 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:54:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 14:54:12 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp20ft664i/a80d69795951480588f57dbf266ea52c.delta /opt/stack/data/nova/instances/snapshots/tmp20ft664i/a80d69795951480588f57dbf266ea52c {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:12 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:54:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp20ft664i/a80d69795951480588f57dbf266ea52c.delta /opt/stack/data/nova/instances/snapshots/tmp20ft664i/a80d69795951480588f57dbf266ea52c" returned: 0 in 0.901s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:13 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Snapshot extracted, beginning image upload
Jul 24 14:54:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:16 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:54:16 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7408MB free_disk=25.75371551513672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:16 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Snapshot image upload complete
Jul 24 14:54:16 user nova-compute[70645]: INFO nova.compute.manager [None req-0f14abe5-ddfd-4abe-8a6e-e911fe100bed tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Took 5.87 seconds to snapshot the instance on the hypervisor.
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 046adfbd-fa5f-45f5-ae62-ddc0f834d450 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance f1a667e2-7992-44e4-9500-fa598493e173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 07268543-d6a3-479b-a4b9-e0cc87bb068a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance ea55b3b9-4821-4400-b99f-ba233c2a7395 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance a816f335-7f2e-4121-9667-237b22349724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance d2c5d524-aade-4229-b12a-f953c25eaa40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 2518724a-a4f8-44e6-8820-1019289e65fc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:54:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lazy-loading 'flavor' on Instance uuid c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:17 user nova-compute[70645]: INFO nova.compute.manager [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Attaching volume 6f857c39-6456-4084-84c8-e056ea580e84 to /dev/vdb
Jul 24 14:54:17 user nova-compute[70645]: DEBUG os_brick.utils [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6110e82-b187-459c-b690-5c720f0f90e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb44f72-98bb-4be2-8ba5-b44ff4e392a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8086c40c-4991-44ce-a924-d68537c424fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25d72e2-adb5-4d05-946a-7ea07d82144f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:17 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[05145dba-cc61-4aa7-8418-ff34c78dcaea]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG os_brick.utils [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Updating existing volume attachment record: c74ca031-62b6-465e-b61b-b7a4ff3ad514 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:54:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Updating instance_info_cache with network_info: [{"id": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "address": "fa:16:3e:39:c5:2a", "network": {"id": "b14f49ac-5556-4859-95b1-c023b561c024", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-256905356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a317c1438c54fd499cf503d88f0ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb181692f-43", "ovs_interfaceid": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:54:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 14:54:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.compute.manager [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:54:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Creating image(s)
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Ensure instance console log exists: /opt/stack/data/nova/instances/d2c5d524-aade-4229-b12a-f953c25eaa40/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Start _get_guest_xml network_info=[{"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1ea84107-20f2-4b2e-82d6-908d311e1bd1', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUrtipnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2c5d524-aade-4229-b12a-f953c25eaa40', 'attached_at': '', 'detached_at': '', 'volume_id': 'e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4', 'serial': 'e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None}, {'attachment_id': 'e4576176-c34d-4419-be46-3862291d3d9d', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsafIMic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2c5d524-aade-4229-b12a-f953c25eaa40', 'attached_at': '', 'detached_at': '', 'volume_id': '06c9e837-c0a9-4f8d-971d-6574c794f321', 'serial': '06c9e837-c0a9-4f8d-971d-6574c794f321'}, 'guest_format': None, 'boot_index': 1, 'volume_type': None}, {'attachment_id': 'c40b781c-e8ee-4751-bfcf-946d4659a352', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sILZWwkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2c5d524-aade-4229-b12a-f953c25eaa40', 'attached_at': '', 'detached_at': '', 'volume_id': '3f1d687d-8f99-4341-8f13-70659cca8c92', 'serial': '3f1d687d-8f99-4341-8f13-70659cca8c92'}, 'guest_format': None, 'boot_index': 2, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:54:21 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:54:21 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:54:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connector [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Factory for ISCSI on None {{(pid=70645) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.010s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUrtipnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:22 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:22 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:22 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[710b2b43-6a75-4ab3-8860-d32aca53b605]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:54:22 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d034f00-d302-4c42-891c-255f15739b02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4] added
Jul 24 14:54:22 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2525d06e-5675-432b-8eb9-1fd5f3216069]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e62a325-bcb8-46c2-8647-121b7f13e105]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUrtipnq {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUrtipnq" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ecfd49-eae5-42a7-89e3-1e7c436251b3]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HUrtipnq'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[57410182-c628-4d9b-815a-d95377df843e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8745010-3c79-48c0-96b2-1ca4a1390c2a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 14:54:22 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 14:54:22 user nova-compute[70645]:  {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:22 user nova-compute[70645]: WARNING os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 14:54:22 user nova-compute[70645]: 
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[071a5417-c1aa-4a35-84e4-0f3161e838bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4, portal: 172.16.0.220,3260]
Jul 24 14:54:22 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4, portal: 172.16.0.220,3260] successful.
Jul 24 14:54:22 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0887394-376c-4ac9-a510-c25d3b78d620]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b781597a-bf47-4b2b-b7d1-281f96639e56]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:22 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:22 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c822c353-ea14-41e8-b828-8a14d8a7eb54]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:54:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUrtipnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23862666135333534', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862666135333534', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsafIMic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:23 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:23 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:23 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d19655-52ea-45f5-bc8e-a3c63eb8d2b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:54:23 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[54387b17-ae34-47dd-8c58-a14ecc109627]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321] added
Jul 24 14:54:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e57caa1-0db4-4d6b-a54e-74e8394980d1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.117s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fb44b8-a594-40ef-b589-97d59b601b33]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rsafIMic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rsafIMic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3641de5-832a-4c0f-9c99-dbd50d09c859]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rsafIMic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5489d259-ca56-4951-be9e-33d2729e267c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6058abcb-9d38-4b1d-acc5-9096348c84cb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[35806d67-0cf0-4bd7-9941-c7aaf66c18f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321, portal: 172.16.0.220,3260]
Jul 24 14:54:23 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321, portal: 172.16.0.220,3260] successful.
Jul 24 14:54:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a709f497-204d-4648-811b-7c7668a93de7]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd254fc-bc50-4943-8d10-33f4b3f95638]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:23 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:23 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[610ec1ac-106c-4b3b-945c-bc22a784b825]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:54:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsafIMic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23361326263333932', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361326263333932', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sILZWwkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:24 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:24 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:24 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe35135-4dda-488d-896d-2556e384398c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:54:24 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c3d98a-a0c7-4022-9433-f7b1b12a44a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92] added
Jul 24 14:54:24 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f505c15-acd0-4142-9310-162ec3bfd759]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aaa055-f351-401f-bcf0-377841d937ff]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sILZWwkl {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sILZWwkl" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c38da67-35ac-4928-b310-508e90c53641]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sILZWwkl'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7582d04-eab3-4e8b-befe-b967c70fa0ea]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0114b9-8d0f-4f66-a7ba-0911871e399b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:25 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:25 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[197cf80f-a01e-4658-aff5-fa3fe4786033]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92, portal: 172.16.0.220,3260]
Jul 24 14:54:25 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92, portal: 172.16.0.220,3260] successful.
Jul 24 14:54:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f45a30-2ded-4abc-a78b-2e403d96d599]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a670ef-764d-489b-8e1e-ee22f4df0523]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:25 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:25 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:25 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:25 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed11c7e9-3bfb-482d-bf83-53cd230a78b8]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:54:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sILZWwkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:54:26 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Creating image(s)
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Ensure instance console log exists: /opt/stack/data/nova/instances/2518724a-a4f8-44e6-8820-1019289e65fc/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Start _get_guest_xml network_info=[{"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3eb8f409-56ed-487a-a202-7f038d553e33', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAqFcnyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2518724a-a4f8-44e6-8820-1019289e65fc', 'attached_at': '', 'detached_at': '', 'volume_id': '484b7324-9c66-458e-9fb0-94c5bc0871d4', 'serial': '484b7324-9c66-458e-9fb0-94c5bc0871d4'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None}, {'attachment_id': '9a405d5c-a423-41bd-a75b-39f0e5b2c0b4', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CNLUdzuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2518724a-a4f8-44e6-8820-1019289e65fc', 'attached_at': '', 'detached_at': '', 'volume_id': 'c02ec91b-9962-41a2-8ffa-d64bf810057f', 'serial': 'c02ec91b-9962-41a2-8ffa-d64bf810057f'}, 'guest_format': None, 'boot_index': 1, 'volume_type': None}, {'attachment_id': '3afb05f4-0f34-4178-821c-fd67ba3d0660', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGZfwHrb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2518724a-a4f8-44e6-8820-1019289e65fc', 'attached_at': '', 'detached_at': '', 'volume_id': '59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357', 'serial': '59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357'}, 'guest_format': None, 'boot_index': 2, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:54:26 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:54:26 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAqFcnyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:26 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23936623630306132', 'path': '/dev/sdd'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936623630306132', 'path': '/dev/sdd'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:26 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:26 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:60:ef,bridge_name='br-int',has_traffic_filtering=True,id=6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f,network=Network(3dd2fe24-cb5b-4370-82bb-75def0166773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9a98e9-ec') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:5e:80,bridge_name='br-int',has_traffic_filtering=True,id=db1a0d8c-19bf-4a1e-b526-7261733683c9,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb1a0d8c-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:b0,bridge_name='br-int',has_traffic_filtering=True,id=d1022a74-2c30-4f91-b050-85f97db29e4d,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1022a74-2c') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:bd:fe,bridge_name='br-int',has_traffic_filtering=True,id=a36dd022-bb0f-4848-8fbf-f5c4fb84179c,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36dd022-bb') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=cb07e6e6-49dd-4330-89b5-6b93af6ed2bd,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb07e6e6-49') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=e2a1f009-ae21-459d-ae50-8b3b6fb3d545,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a1f009-ae') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a8,bridge_name='br-int',has_traffic_filtering=True,id=0204e20d-6b04-425c-9141-236a993c3d98,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204e20d-6b') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.objects.instance [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lazy-loading 'pci_devices' on Instance uuid d2c5d524-aade-4229-b12a-f953c25eaa40 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d59d0a-fc16-42d1-b662-4d0e46870032]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:54:26 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:54:26 user nova-compute[70645]:   <uuid>d2c5d524-aade-4229-b12a-f953c25eaa40</uuid>
Jul 24 14:54:26 user nova-compute[70645]:   <name>instance-00000009</name>
Jul 24 14:54:26 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:54:26 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:54:26 user nova-compute[70645]:   <metadata>
Jul 24 14:54:26 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:54:26 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:54:26 user nova-compute[70645]:       <nova:name>tempest-device-tagging-server-1568191530</nova:name>
Jul 24 14:54:26 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:54:21</nova:creationTime>
Jul 24 14:54:26 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:54:26 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:54:26 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:54:26 user nova-compute[70645]:       <nova:owner>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:user uuid="8623aa5d4d1442bfb72081293363fb83">tempest-TaggedBootDevicesTest-1354903190-project-member</nova:user>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:project uuid="374ec2672f3b4469aca169a69c153520">tempest-TaggedBootDevicesTest-1354903190</nova:project>
Jul 24 14:54:26 user nova-compute[70645]:       </nova:owner>
Jul 24 14:54:26 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:54:26 user nova-compute[70645]:       <nova:ports>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:port uuid="6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f">
Jul 24 14:54:26 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 14:54:26 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:port uuid="db1a0d8c-19bf-4a1e-b526-7261733683c9">
Jul 24 14:54:26 user nova-compute[70645]:           <nova:ip type="fixed" address="10.1.1.230" ipVersion="4"/>
Jul 24 14:54:26 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:port uuid="d1022a74-2c30-4f91-b050-85f97db29e4d">
Jul 24 14:54:26 user nova-compute[70645]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
Jul 24 14:54:26 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:port uuid="a36dd022-bb0f-4848-8fbf-f5c4fb84179c">
Jul 24 14:54:26 user nova-compute[70645]:           <nova:ip type="fixed" address="10.1.1.159" ipVersion="4"/>
Jul 24 14:54:26 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:port uuid="cb07e6e6-49dd-4330-89b5-6b93af6ed2bd">
Jul 24 14:54:26 user nova-compute[70645]:           <nova:ip type="fixed" address="10.1.1.39" ipVersion="4"/>
Jul 24 14:54:26 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:port uuid="e2a1f009-ae21-459d-ae50-8b3b6fb3d545">
Jul 24 14:54:26 user nova-compute[70645]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 24 14:54:26 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:26 user nova-compute[70645]:         <nova:port uuid="0204e20d-6b04-425c-9141-236a993c3d98">
Jul 24 14:54:26 user nova-compute[70645]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 24 14:54:26 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:26 user nova-compute[70645]:       </nova:ports>
Jul 24 14:54:26 user nova-compute[70645]:     </nova:instance>
Jul 24 14:54:26 user nova-compute[70645]:   </metadata>
Jul 24 14:54:26 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:54:26 user nova-compute[70645]:     <system>
Jul 24 14:54:26 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:54:26 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:54:26 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:54:26 user nova-compute[70645]:       <entry name="serial">d2c5d524-aade-4229-b12a-f953c25eaa40</entry>
Jul 24 14:54:26 user nova-compute[70645]:       <entry name="uuid">d2c5d524-aade-4229-b12a-f953c25eaa40</entry>
Jul 24 14:54:26 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:54:26 user nova-compute[70645]:     </system>
Jul 24 14:54:26 user nova-compute[70645]:   </sysinfo>
Jul 24 14:54:26 user nova-compute[70645]:   <os>
Jul 24 14:54:26 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:54:26 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:54:26 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:54:26 user nova-compute[70645]:   </os>
Jul 24 14:54:26 user nova-compute[70645]:   <features>
Jul 24 14:54:26 user nova-compute[70645]:     <acpi/>
Jul 24 14:54:26 user nova-compute[70645]:     <apic/>
Jul 24 14:54:26 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:54:26 user nova-compute[70645]:   </features>
Jul 24 14:54:26 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:54:26 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:54:26 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:54:26 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:54:26 user nova-compute[70645]:   </clock>
Jul 24 14:54:26 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:54:26 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:54:26 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:54:26 user nova-compute[70645]:   </cpu>
Jul 24 14:54:26 user nova-compute[70645]:   <devices>
Jul 24 14:54:26 user nova-compute[70645]:     <disk type="file" device="cdrom">
Jul 24 14:54:26 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 14:54:26 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/d2c5d524-aade-4229-b12a-f953c25eaa40/disk.config"/>
Jul 24 14:54:26 user nova-compute[70645]:       <target dev="hda" bus="ide"/>
Jul 24 14:54:26 user nova-compute[70645]:     </disk>
Jul 24 14:54:26 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 14:54:26 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:54:26 user nova-compute[70645]:       <source dev="/dev/sdb"/>
Jul 24 14:54:26 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:54:26 user nova-compute[70645]:       <serial>e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4</serial>
Jul 24 14:54:26 user nova-compute[70645]:     </disk>
Jul 24 14:54:26 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 14:54:26 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:54:26 user nova-compute[70645]:       <source dev="/dev/sdc"/>
Jul 24 14:54:26 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 14:54:26 user nova-compute[70645]:       <serial>06c9e837-c0a9-4f8d-971d-6574c794f321</serial>
Jul 24 14:54:26 user nova-compute[70645]:     </disk>
Jul 24 14:54:26 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 14:54:26 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:54:26 user nova-compute[70645]:       <source dev="/dev/sdd"/>
Jul 24 14:54:26 user nova-compute[70645]:       <target dev="vdc" bus="virtio"/>
Jul 24 14:54:26 user nova-compute[70645]:       <serial>3f1d687d-8f99-4341-8f13-70659cca8c92</serial>
Jul 24 14:54:26 user nova-compute[70645]:     </disk>
Jul 24 14:54:26 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:26 user nova-compute[70645]:       <mac address="fa:16:3e:a9:60:ef"/>
Jul 24 14:54:26 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:26 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:26 user nova-compute[70645]:       <target dev="tap6c9a98e9-ec"/>
Jul 24 14:54:26 user nova-compute[70645]:     </interface>
Jul 24 14:54:26 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:26 user nova-compute[70645]:       <mac address="fa:16:3e:dd:5e:80"/>
Jul 24 14:54:26 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:26 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:26 user nova-compute[70645]:       <target dev="tapdb1a0d8c-19"/>
Jul 24 14:54:26 user nova-compute[70645]:     </interface>
Jul 24 14:54:26 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:26 user nova-compute[70645]:       <mac address="fa:16:3e:9c:b5:b0"/>
Jul 24 14:54:26 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:26 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:26 user nova-compute[70645]:       <target dev="tapd1022a74-2c"/>
Jul 24 14:54:26 user nova-compute[70645]:     </interface>
Jul 24 14:54:26 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:26 user nova-compute[70645]:       <mac address="fa:16:3e:55:bd:fe"/>
Jul 24 14:54:26 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:26 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:26 user nova-compute[70645]:       <target dev="tapa36dd022-bb"/>
Jul 24 14:54:26 user nova-compute[70645]:     </interface>
Jul 24 14:54:26 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:26 user nova-compute[70645]:       <mac address="fa:16:3e:37:0e:32"/>
Jul 24 14:54:26 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:26 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:26 user nova-compute[70645]:       <target dev="tapcb07e6e6-49"/>
Jul 24 14:54:26 user nova-compute[70645]:     </interface>
Jul 24 14:54:26 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:26 user nova-compute[70645]:       <mac address="fa:16:3e:59:fc:01"/>
Jul 24 14:54:26 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:26 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:26 user nova-compute[70645]:       <target dev="tape2a1f009-ae"/>
Jul 24 14:54:26 user nova-compute[70645]:     </interface>
Jul 24 14:54:26 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:26 user nova-compute[70645]:       <mac address="fa:16:3e:44:c1:a8"/>
Jul 24 14:54:26 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:26 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:26 user nova-compute[70645]:       <target dev="tap0204e20d-6b"/>
Jul 24 14:54:26 user nova-compute[70645]:     </interface>
Jul 24 14:54:26 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:54:26 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/d2c5d524-aade-4229-b12a-f953c25eaa40/console.log" append="off"/>
Jul 24 14:54:26 user nova-compute[70645]:     </serial>
Jul 24 14:54:26 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:54:26 user nova-compute[70645]:     <video>
Jul 24 14:54:26 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:26 user nova-compute[70645]:     </video>
Jul 24 14:54:26 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:54:26 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:54:26 user nova-compute[70645]:     </rng>
Jul 24 14:54:26 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:54:26 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:54:26 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:54:26 user nova-compute[70645]:     </memballoon>
Jul 24 14:54:26 user nova-compute[70645]:   </devices>
Jul 24 14:54:26 user nova-compute[70645]: </domain>
Jul 24 14:54:26 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:60:ef,bridge_name='br-int',has_traffic_filtering=True,id=6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f,network=Network(3dd2fe24-cb5b-4370-82bb-75def0166773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9a98e9-ec') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:60:ef,bridge_name='br-int',has_traffic_filtering=True,id=6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f,network=Network(3dd2fe24-cb5b-4370-82bb-75def0166773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9a98e9-ec') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d95ed9-594a-46e0-8b19-0102102d062d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4] added
Jul 24 14:54:26 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9a98e9-ec, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c9a98e9-ec, col_values=(('external_ids', {'iface-id': '6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:60:ef', 'vm-uuid': 'd2c5d524-aade-4229-b12a-f953c25eaa40'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f434f818-4954-4146-a392-d3dddc5c3a94]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: INFO os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:60:ef,bridge_name='br-int',has_traffic_filtering=True,id=6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f,network=Network(3dd2fe24-cb5b-4370-82bb-75def0166773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9a98e9-ec')
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:5e:80,bridge_name='br-int',has_traffic_filtering=True,id=db1a0d8c-19bf-4a1e-b526-7261733683c9,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb1a0d8c-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:5e:80,bridge_name='br-int',has_traffic_filtering=True,id=db1a0d8c-19bf-4a1e-b526-7261733683c9,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb1a0d8c-19') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb1a0d8c-19, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb1a0d8c-19, col_values=(('external_ids', {'iface-id': 'db1a0d8c-19bf-4a1e-b526-7261733683c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:5e:80', 'vm-uuid': 'd2c5d524-aade-4229-b12a-f953c25eaa40'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78ecde2-6caf-44ee-b6f4-1e4906e15936]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QAqFcnyx {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: INFO os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:5e:80,bridge_name='br-int',has_traffic_filtering=True,id=db1a0d8c-19bf-4a1e-b526-7261733683c9,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb1a0d8c-19')
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:b0,bridge_name='br-int',has_traffic_filtering=True,id=d1022a74-2c30-4f91-b050-85f97db29e4d,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1022a74-2c') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:b0,bridge_name='br-int',has_traffic_filtering=True,id=d1022a74-2c30-4f91-b050-85f97db29e4d,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1022a74-2c') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QAqFcnyx" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4424f189-45d6-4d39-89b9-033e1fe6aeef]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QAqFcnyx'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1022a74-2c, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1022a74-2c, col_values=(('external_ids', {'iface-id': 'd1022a74-2c30-4f91-b050-85f97db29e4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:b5:b0', 'vm-uuid': 'd2c5d524-aade-4229-b12a-f953c25eaa40'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec27942c-5d62-4cb0-bfa5-51444ef2a775]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: INFO os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:b0,bridge_name='br-int',has_traffic_filtering=True,id=d1022a74-2c30-4f91-b050-85f97db29e4d,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1022a74-2c')
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:bd:fe,bridge_name='br-int',has_traffic_filtering=True,id=a36dd022-bb0f-4848-8fbf-f5c4fb84179c,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36dd022-bb') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:bd:fe,bridge_name='br-int',has_traffic_filtering=True,id=a36dd022-bb0f-4848-8fbf-f5c4fb84179c,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36dd022-bb') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa36dd022-bb, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa36dd022-bb, col_values=(('external_ids', {'iface-id': 'a36dd022-bb0f-4848-8fbf-f5c4fb84179c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:bd:fe', 'vm-uuid': 'd2c5d524-aade-4229-b12a-f953c25eaa40'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cea2ee-3abe-4980-83f1-1d35d003631e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: INFO os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:bd:fe,bridge_name='br-int',has_traffic_filtering=True,id=a36dd022-bb0f-4848-8fbf-f5c4fb84179c,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36dd022-bb')
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=cb07e6e6-49dd-4330-89b5-6b93af6ed2bd,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb07e6e6-49') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=cb07e6e6-49dd-4330-89b5-6b93af6ed2bd,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb07e6e6-49') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb07e6e6-49, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb07e6e6-49, col_values=(('external_ids', {'iface-id': 'cb07e6e6-49dd-4330-89b5-6b93af6ed2bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:0e:32', 'vm-uuid': 'd2c5d524-aade-4229-b12a-f953c25eaa40'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[917b0c13-4d9a-4135-8708-3c9d30e29f2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4, portal: 172.16.0.220,3260]
Jul 24 14:54:26 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4, portal: 172.16.0.220,3260] successful.
Jul 24 14:54:26 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a109e31c-5143-4fc4-8950-6f3f448e33f0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: INFO os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=cb07e6e6-49dd-4330-89b5-6b93af6ed2bd,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb07e6e6-49')
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=e2a1f009-ae21-459d-ae50-8b3b6fb3d545,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a1f009-ae') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=e2a1f009-ae21-459d-ae50-8b3b6fb3d545,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a1f009-ae') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2a1f009-ae, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2a1f009-ae, col_values=(('external_ids', {'iface-id': 'e2a1f009-ae21-459d-ae50-8b3b6fb3d545', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:fc:01', 'vm-uuid': 'd2c5d524-aade-4229-b12a-f953c25eaa40'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be594be-60f4-4c95-9d8b-1d0000634fff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:26 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUReFScf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:26 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[90329b37-1d3e-42c6-8018-b68c0ed42a9e]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAqFcnyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: INFO os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=e2a1f009-ae21-459d-ae50-8b3b6fb3d545,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a1f009-ae')
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a8,bridge_name='br-int',has_traffic_filtering=True,id=0204e20d-6b04-425c-9141-236a993c3d98,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204e20d-6b') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a8,bridge_name='br-int',has_traffic_filtering=True,id=0204e20d-6b04-425c-9141-236a993c3d98,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204e20d-6b') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0204e20d-6b, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0204e20d-6b, col_values=(('external_ids', {'iface-id': '0204e20d-6b04-425c-9141-236a993c3d98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:c1:a8', 'vm-uuid': 'd2c5d524-aade-4229-b12a-f953c25eaa40'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:26 user nova-compute[70645]: INFO os_vif [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a8,bridge_name='br-int',has_traffic_filtering=True,id=0204e20d-6b04-425c-9141-236a993c3d98,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204e20d-6b')
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] No BDM found with device name hda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] No VIF found with MAC fa:16:3e:a9:60:ef, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] No VIF found with MAC fa:16:3e:37:0e:32, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:54:26 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Using config drive
Jul 24 14:54:26 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Creating config drive at /opt/stack/data/nova/instances/d2c5d524-aade-4229-b12a-f953c25eaa40/disk.config
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d2c5d524-aade-4229-b12a-f953c25eaa40/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpawjy85vi {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d2c5d524-aade-4229-b12a-f953c25eaa40/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpawjy85vi" returned: 0 in 0.054s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23036343132343161', 'path': '/dev/sde'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036343132343161', 'path': '/dev/sde'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.013s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:27 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:27 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be9cb18-bedc-4541-9ef4-285dd131d449]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:54:27 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CNLUdzuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:27 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f278b889-be4e-4c18-b948-811cdbd46e29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84] added
Jul 24 14:54:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[169e3da5-b5cc-4f5c-80ef-cb71a4f660f1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5046145-c40c-4cc7-a310-268f1c5e8f0d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUReFScf {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUReFScf" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9074eb12-fdb9-44f0-bac6-18db4dff457f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUReFScf'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[149db118-2e25-486f-885c-642fb8f68cf4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51de2c9-e2a8-49a3-b02c-80647f5b4da2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e64be71-4d0f-41c7-92f9-3b19a94d52e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84, portal: 172.16.0.220,3260]
Jul 24 14:54:27 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84, portal: 172.16.0.220,3260] successful.
Jul 24 14:54:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG nova.compute.manager [req-d539e4f7-8637-4093-89bd-b6b96a2503e8 req-caafa69c-6b54-4fe5-80f3-359e72333d1f service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Received event network-changed-ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG nova.compute.manager [req-d539e4f7-8637-4093-89bd-b6b96a2503e8 req-caafa69c-6b54-4fe5-80f3-359e72333d1f service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Refreshing instance network info cache due to event network-changed-ae0cfcb9-c004-4e79-b81b-93401c1629c7. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d539e4f7-8637-4093-89bd-b6b96a2503e8 req-caafa69c-6b54-4fe5-80f3-359e72333d1f service nova] Acquiring lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d539e4f7-8637-4093-89bd-b6b96a2503e8 req-caafa69c-6b54-4fe5-80f3-359e72333d1f service nova] Acquired lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG nova.network.neutron [req-d539e4f7-8637-4093-89bd-b6b96a2503e8 req-caafa69c-6b54-4fe5-80f3-359e72333d1f service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Refreshing network info cache for port ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[83654885-77c2-41aa-a10d-a648a41bfd4e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b777280-3508-4f4e-8c0b-3026261a4a76]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0206a9-4a02-4033-80b5-fa50f3a3c0dd]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG nova.network.neutron [req-d539e4f7-8637-4093-89bd-b6b96a2503e8 req-caafa69c-6b54-4fe5-80f3-359e72333d1f service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Updated VIF entry in instance network info cache for port ae0cfcb9-c004-4e79-b81b-93401c1629c7. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG nova.network.neutron [req-d539e4f7-8637-4093-89bd-b6b96a2503e8 req-caafa69c-6b54-4fe5-80f3-359e72333d1f service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Updating instance_info_cache with network_info: [{"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d539e4f7-8637-4093-89bd-b6b96a2503e8 req-caafa69c-6b54-4fe5-80f3-359e72333d1f service nova] Releasing lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-75b90fa8-c3fa-4601-a926-d198e86b6a1f req-08685952-f6f3-4168-80ca-613cfc5fab9f service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-75b90fa8-c3fa-4601-a926-d198e86b6a1f req-08685952-f6f3-4168-80ca-613cfc5fab9f service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-75b90fa8-c3fa-4601-a926-d198e86b6a1f req-08685952-f6f3-4168-80ca-613cfc5fab9f service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-75b90fa8-c3fa-4601-a926-d198e86b6a1f req-08685952-f6f3-4168-80ca-613cfc5fab9f service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-75b90fa8-c3fa-4601-a926-d198e86b6a1f req-08685952-f6f3-4168-80ca-613cfc5fab9f service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:28 user nova-compute[70645]: WARNING nova.compute.manager [req-75b90fa8-c3fa-4601-a926-d198e86b6a1f req-08685952-f6f3-4168-80ca-613cfc5fab9f service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f for instance with vm_state building and task_state spawning.
Jul 24 14:54:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUReFScf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] <== connect_volume: return (2356ms) {'type': 'block', 'scsi_wwn': '23564393631643331', 'path': '/dev/sdf'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564393631643331', 'path': '/dev/sdf'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.312s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:28 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:28 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lazy-loading 'flavor' on Instance uuid c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a28d2bd-b8b7-49d1-b8d3-4f9cca2319b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:54:28 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 14:54:28 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:54:28 user nova-compute[70645]:   <source dev="/dev/sdf"/>
Jul 24 14:54:28 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:54:28 user nova-compute[70645]:   <serial>6f857c39-6456-4084-84c8-e056ea580e84</serial>
Jul 24 14:54:28 user nova-compute[70645]: </disk>
Jul 24 14:54:28 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9f463a-bfd8-4063-a2b7-da13c571ee91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f] added
Jul 24 14:54:28 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a61791-58bf-4562-93c5-22faa63f6fc1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d5a8b4-6f3d-4c22-be83-52e79d75ef52]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CNLUdzuo {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CNLUdzuo" returned: 0 in 0.032s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[30acb1f8-9ddf-4eb4-a3eb-7f5512f160bd]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CNLUdzuo'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc930f16-8ac0-4dc2-8b71-db5a5cc95886]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7f38bc-1874-4a4b-9cba-3bb92c36c3f9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57a5da1-fd37-47d6-af50-a193b986fc58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f, portal: 172.16.0.220,3260]
Jul 24 14:54:29 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f, portal: 172.16.0.220,3260] successful.
Jul 24 14:54:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54ab84f-6bd3-4afc-bc72-eca6712a29e5]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8cfed3-b5fe-4180-8574-bc81a30410c8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:29 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fad75e-2507-49ce-bf9e-d5eabdf843fb]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] No VIF found with MAC fa:16:3e:39:c5:2a, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0c027880-6e7e-4bbd-be35-7ea045529aae tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.441s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-d1022a74-2c30-4f91-b050-85f97db29e4d {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-d1022a74-2c30-4f91-b050-85f97db29e4d {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:29 user nova-compute[70645]: WARNING nova.compute.manager [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-d1022a74-2c30-4f91-b050-85f97db29e4d for instance with vm_state building and task_state spawning.
Jul 24 14:54:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-d1022a74-2c30-4f91-b050-85f97db29e4d {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-d1022a74-2c30-4f91-b050-85f97db29e4d {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:29 user nova-compute[70645]: WARNING nova.compute.manager [req-bb55f6be-6b1a-414c-b16f-5d2effdfe521 req-8953da11-dda3-4bb9-acf3-f43c5b8efcbe service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-d1022a74-2c30-4f91-b050-85f97db29e4d for instance with vm_state building and task_state spawning.
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-9f96f6e1-fefd-4ddf-bbbf-67ca9c268dbc req-33b587c8-b149-482a-a410-dc0e1ec67b8c service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9f96f6e1-fefd-4ddf-bbbf-67ca9c268dbc req-33b587c8-b149-482a-a410-dc0e1ec67b8c service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9f96f6e1-fefd-4ddf-bbbf-67ca9c268dbc req-33b587c8-b149-482a-a410-dc0e1ec67b8c service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9f96f6e1-fefd-4ddf-bbbf-67ca9c268dbc req-33b587c8-b149-482a-a410-dc0e1ec67b8c service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-9f96f6e1-fefd-4ddf-bbbf-67ca9c268dbc req-33b587c8-b149-482a-a410-dc0e1ec67b8c service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:30 user nova-compute[70645]: WARNING nova.compute.manager [req-9f96f6e1-fefd-4ddf-bbbf-67ca9c268dbc req-33b587c8-b149-482a-a410-dc0e1ec67b8c service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c for instance with vm_state building and task_state spawning.
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CNLUdzuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] <== connect_volume: return (2713ms) {'type': 'block', 'scsi_wwn': '23334343663656261', 'path': '/dev/sdg'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334343663656261', 'path': '/dev/sdg'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGZfwHrb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:30 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:30 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:30 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[143dfec4-76d2-48bf-8889-3f460f5d4571]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:54:30 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[964580d9-9cd9-441a-9a24-91b10d950e3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357] added
Jul 24 14:54:30 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dde3eb-76f3-4e5b-aa03-477bafdee9a0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.048s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9d916-e80d-47cc-8bef-5956adcbbf69]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jGZfwHrb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jGZfwHrb" returned: 0 in 0.040s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f315eb81-d2ce-44c5-a6df-85f1c1b2ade4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jGZfwHrb'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[390fd691-70ca-4fd8-9b83-cc16dce2087c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a532ac-00b4-401c-b304-a6ef64c22b90]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:30 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:30 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f869b79-8b34-49c8-b71e-e10a439bc6e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357, portal: 172.16.0.220,3260]
Jul 24 14:54:30 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357, portal: 172.16.0.220,3260] successful.
Jul 24 14:54:30 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f5e7ba-7ee0-4e83-af3b-6e33ab718ebf]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1a009f-4f10-45e1-b04a-f8cc6c5a2c3e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:30 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:30 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaa41be-1206-4eab-8260-a3edebaa0cb2]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGZfwHrb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:30 user nova-compute[70645]: WARNING nova.compute.manager [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f for instance with vm_state building and task_state spawning.
Jul 24 14:54:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:30 user nova-compute[70645]: WARNING nova.compute.manager [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 for instance with vm_state building and task_state spawning.
Jul 24 14:54:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:30 user nova-compute[70645]: WARNING nova.compute.manager [req-87477cc3-af14-4a25-8426-cbc4ea872b9a req-a81823c2-cd57-4e78-8b08-047060dd92e3 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 for instance with vm_state building and task_state spawning.
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:30 user nova-compute[70645]: INFO nova.compute.manager [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Terminating instance
Jul 24 14:54:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Instance destroyed successfully.
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lazy-loading 'resources' on Instance uuid c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1448032674',display_name='tempest-DeleteServersTestJSON-server-1448032674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1448032674',id=2,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a317c1438c54fd499cf503d88f0ee19',ramdisk_id='',reservation_id='r-k0n0vb5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2063757654',owner_user_name='tempest-DeleteServersTestJSON-2063757654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:52:37Z,user_data=None,user_id='c27b0d1a7806484e99a8c8f7646ac9e6',uuid=c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "address": "fa:16:3e:39:c5:2a", "network": {"id": "b14f49ac-5556-4859-95b1-c023b561c024", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-256905356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a317c1438c54fd499cf503d88f0ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb181692f-43", "ovs_interfaceid": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Converting VIF {"id": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "address": "fa:16:3e:39:c5:2a", "network": {"id": "b14f49ac-5556-4859-95b1-c023b561c024", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-256905356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a317c1438c54fd499cf503d88f0ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb181692f-43", "ovs_interfaceid": "b181692f-4377-4a92-81ee-8d60f6fb4c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:c5:2a,bridge_name='br-int',has_traffic_filtering=True,id=b181692f-4377-4a92-81ee-8d60f6fb4c96,network=Network(b14f49ac-5556-4859-95b1-c023b561c024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb181692f-43') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_vif [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:c5:2a,bridge_name='br-int',has_traffic_filtering=True,id=b181692f-4377-4a92-81ee-8d60f6fb4c96,network=Network(b14f49ac-5556-4859-95b1-c023b561c024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb181692f-43') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb181692f-43, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: INFO os_vif [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:c5:2a,bridge_name='br-int',has_traffic_filtering=True,id=b181692f-4377-4a92-81ee-8d60f6fb4c96,network=Network(b14f49ac-5556-4859-95b1-c023b561c024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb181692f-43')
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '26262653461386236', 'path': '/dev/sdh'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262653461386236', 'path': '/dev/sdh'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUReFScf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:31 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2ffa78-4984-4a4b-b541-64759409fcc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb7a112-ccd1-4e35-a3f1-ea074d2cccd7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:31 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba942b0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84'): ({'sdf'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Removing single pathed devices sdf {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=770c4d59-3054-4195-94cf-facdbc1d5ca7,network=Network(d2542284-26af-46bb-b7a7-565471dfe1c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c4d59-30') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:c6:45,bridge_name='br-int',has_traffic_filtering=True,id=686c5c08-20e1-482b-96c2-30a6e4e99203,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap686c5c08-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=b6f5ddb9-961a-4001-9d43-740bc19cda82,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f5ddb9-96') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:10:15,bridge_name='br-int',has_traffic_filtering=True,id=cabd5e47-5488-47f2-a96e-92de070a8267,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcabd5e47-54') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:14:4e,bridge_name='br-int',has_traffic_filtering=True,id=be328240-94a4-416a-97d7-e379d07e2e64,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe328240-94') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ae:82,bridge_name='br-int',has_traffic_filtering=True,id=76732353-b1bb-426d-ab39-0ccbefcef0a3,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76732353-b1') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:52:1f,bridge_name='br-int',has_traffic_filtering=True,id=0a5e5bdf-2fab-444f-ae3a-8cd841b013e9,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5e5bdf-2f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lazy-loading 'pci_devices' on Instance uuid 2518724a-a4f8-44e6-8820-1019289e65fc {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[072e3569-1b6f-48cd-b677-a6f8f3d16696]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:54:31 user nova-compute[70645]:   <uuid>2518724a-a4f8-44e6-8820-1019289e65fc</uuid>
Jul 24 14:54:31 user nova-compute[70645]:   <name>instance-0000000a</name>
Jul 24 14:54:31 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:54:31 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:54:31 user nova-compute[70645]:   <metadata>
Jul 24 14:54:31 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:54:31 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:54:31 user nova-compute[70645]:       <nova:name>tempest-device-tagging-server-1677375631</nova:name>
Jul 24 14:54:31 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:54:26</nova:creationTime>
Jul 24 14:54:31 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:54:31 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:54:31 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:54:31 user nova-compute[70645]:       <nova:owner>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:user uuid="0c77c805d8534d58b109c9dce509378f">tempest-TaggedBootDevicesTest_v242-432897877-project-member</nova:user>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:project uuid="9eee83177e9c46e8a6b0579b93a33625">tempest-TaggedBootDevicesTest_v242-432897877</nova:project>
Jul 24 14:54:31 user nova-compute[70645]:       </nova:owner>
Jul 24 14:54:31 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:54:31 user nova-compute[70645]:       <nova:ports>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:port uuid="770c4d59-3054-4195-94cf-facdbc1d5ca7">
Jul 24 14:54:31 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 14:54:31 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:port uuid="686c5c08-20e1-482b-96c2-30a6e4e99203">
Jul 24 14:54:31 user nova-compute[70645]:           <nova:ip type="fixed" address="10.1.1.67" ipVersion="4"/>
Jul 24 14:54:31 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:port uuid="b6f5ddb9-961a-4001-9d43-740bc19cda82">
Jul 24 14:54:31 user nova-compute[70645]:           <nova:ip type="fixed" address="10.1.1.112" ipVersion="4"/>
Jul 24 14:54:31 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:port uuid="cabd5e47-5488-47f2-a96e-92de070a8267">
Jul 24 14:54:31 user nova-compute[70645]:           <nova:ip type="fixed" address="10.1.1.139" ipVersion="4"/>
Jul 24 14:54:31 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:port uuid="be328240-94a4-416a-97d7-e379d07e2e64">
Jul 24 14:54:31 user nova-compute[70645]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Jul 24 14:54:31 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:port uuid="76732353-b1bb-426d-ab39-0ccbefcef0a3">
Jul 24 14:54:31 user nova-compute[70645]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 24 14:54:31 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:31 user nova-compute[70645]:         <nova:port uuid="0a5e5bdf-2fab-444f-ae3a-8cd841b013e9">
Jul 24 14:54:31 user nova-compute[70645]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 24 14:54:31 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:31 user nova-compute[70645]:       </nova:ports>
Jul 24 14:54:31 user nova-compute[70645]:     </nova:instance>
Jul 24 14:54:31 user nova-compute[70645]:   </metadata>
Jul 24 14:54:31 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:54:31 user nova-compute[70645]:     <system>
Jul 24 14:54:31 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:54:31 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:54:31 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:54:31 user nova-compute[70645]:       <entry name="serial">2518724a-a4f8-44e6-8820-1019289e65fc</entry>
Jul 24 14:54:31 user nova-compute[70645]:       <entry name="uuid">2518724a-a4f8-44e6-8820-1019289e65fc</entry>
Jul 24 14:54:31 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:54:31 user nova-compute[70645]:     </system>
Jul 24 14:54:31 user nova-compute[70645]:   </sysinfo>
Jul 24 14:54:31 user nova-compute[70645]:   <os>
Jul 24 14:54:31 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:54:31 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:54:31 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:54:31 user nova-compute[70645]:   </os>
Jul 24 14:54:31 user nova-compute[70645]:   <features>
Jul 24 14:54:31 user nova-compute[70645]:     <acpi/>
Jul 24 14:54:31 user nova-compute[70645]:     <apic/>
Jul 24 14:54:31 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:54:31 user nova-compute[70645]:   </features>
Jul 24 14:54:31 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:54:31 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:54:31 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:54:31 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:54:31 user nova-compute[70645]:   </clock>
Jul 24 14:54:31 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:54:31 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:54:31 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:54:31 user nova-compute[70645]:   </cpu>
Jul 24 14:54:31 user nova-compute[70645]:   <devices>
Jul 24 14:54:31 user nova-compute[70645]:     <disk type="file" device="cdrom">
Jul 24 14:54:31 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 14:54:31 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/2518724a-a4f8-44e6-8820-1019289e65fc/disk.config"/>
Jul 24 14:54:31 user nova-compute[70645]:       <target dev="hda" bus="ide"/>
Jul 24 14:54:31 user nova-compute[70645]:     </disk>
Jul 24 14:54:31 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 14:54:31 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:54:31 user nova-compute[70645]:       <source dev="/dev/sde"/>
Jul 24 14:54:31 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:54:31 user nova-compute[70645]:       <serial>484b7324-9c66-458e-9fb0-94c5bc0871d4</serial>
Jul 24 14:54:31 user nova-compute[70645]:     </disk>
Jul 24 14:54:31 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 14:54:31 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:54:31 user nova-compute[70645]:       <source dev="/dev/sdg"/>
Jul 24 14:54:31 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 14:54:31 user nova-compute[70645]:       <serial>c02ec91b-9962-41a2-8ffa-d64bf810057f</serial>
Jul 24 14:54:31 user nova-compute[70645]:     </disk>
Jul 24 14:54:31 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 14:54:31 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:54:31 user nova-compute[70645]:       <source dev="/dev/sdh"/>
Jul 24 14:54:31 user nova-compute[70645]:       <target dev="vdc" bus="virtio"/>
Jul 24 14:54:31 user nova-compute[70645]:       <serial>59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357</serial>
Jul 24 14:54:31 user nova-compute[70645]:     </disk>
Jul 24 14:54:31 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:31 user nova-compute[70645]:       <mac address="fa:16:3e:8d:1e:08"/>
Jul 24 14:54:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:31 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:31 user nova-compute[70645]:       <target dev="tap770c4d59-30"/>
Jul 24 14:54:31 user nova-compute[70645]:     </interface>
Jul 24 14:54:31 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:31 user nova-compute[70645]:       <mac address="fa:16:3e:99:c6:45"/>
Jul 24 14:54:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:31 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:31 user nova-compute[70645]:       <target dev="tap686c5c08-20"/>
Jul 24 14:54:31 user nova-compute[70645]:     </interface>
Jul 24 14:54:31 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:31 user nova-compute[70645]:       <mac address="fa:16:3e:b1:07:d2"/>
Jul 24 14:54:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:31 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:31 user nova-compute[70645]:       <target dev="tapb6f5ddb9-96"/>
Jul 24 14:54:31 user nova-compute[70645]:     </interface>
Jul 24 14:54:31 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:31 user nova-compute[70645]:       <mac address="fa:16:3e:f9:10:15"/>
Jul 24 14:54:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:31 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:31 user nova-compute[70645]:       <target dev="tapcabd5e47-54"/>
Jul 24 14:54:31 user nova-compute[70645]:     </interface>
Jul 24 14:54:31 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:31 user nova-compute[70645]:       <mac address="fa:16:3e:d8:14:4e"/>
Jul 24 14:54:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:31 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:31 user nova-compute[70645]:       <target dev="tapbe328240-94"/>
Jul 24 14:54:31 user nova-compute[70645]:     </interface>
Jul 24 14:54:31 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:31 user nova-compute[70645]:       <mac address="fa:16:3e:f9:ae:82"/>
Jul 24 14:54:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:31 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:31 user nova-compute[70645]:       <target dev="tap76732353-b1"/>
Jul 24 14:54:31 user nova-compute[70645]:     </interface>
Jul 24 14:54:31 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:31 user nova-compute[70645]:       <mac address="fa:16:3e:f5:52:1f"/>
Jul 24 14:54:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:31 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:31 user nova-compute[70645]:       <target dev="tap0a5e5bdf-2f"/>
Jul 24 14:54:31 user nova-compute[70645]:     </interface>
Jul 24 14:54:31 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:54:31 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/2518724a-a4f8-44e6-8820-1019289e65fc/console.log" append="off"/>
Jul 24 14:54:31 user nova-compute[70645]:     </serial>
Jul 24 14:54:31 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:54:31 user nova-compute[70645]:     <video>
Jul 24 14:54:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:31 user nova-compute[70645]:     </video>
Jul 24 14:54:31 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:54:31 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:54:31 user nova-compute[70645]:     </rng>
Jul 24 14:54:31 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:54:31 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:54:31 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:54:31 user nova-compute[70645]:     </memballoon>
Jul 24 14:54:31 user nova-compute[70645]:   </devices>
Jul 24 14:54:31 user nova-compute[70645]: </domain>
Jul 24 14:54:31 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=770c4d59-3054-4195-94cf-facdbc1d5ca7,network=Network(d2542284-26af-46bb-b7a7-565471dfe1c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c4d59-30') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=770c4d59-3054-4195-94cf-facdbc1d5ca7,network=Network(d2542284-26af-46bb-b7a7-565471dfe1c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c4d59-30') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[41417989-cea3-419f-a7be-ad3c94d68d19]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Flushing IO for device /dev/sdf {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap770c4d59-30, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap770c4d59-30, col_values=(('external_ids', {'iface-id': '770c4d59-3054-4195-94cf-facdbc1d5ca7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:1e:08', 'vm-uuid': '2518724a-a4f8-44e6-8820-1019289e65fc'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: INFO os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=770c4d59-3054-4195-94cf-facdbc1d5ca7,network=Network(d2542284-26af-46bb-b7a7-565471dfe1c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c4d59-30')
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:c6:45,bridge_name='br-int',has_traffic_filtering=True,id=686c5c08-20e1-482b-96c2-30a6e4e99203,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap686c5c08-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:c6:45,bridge_name='br-int',has_traffic_filtering=True,id=686c5c08-20e1-482b-96c2-30a6e4e99203,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap686c5c08-20') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap686c5c08-20, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap686c5c08-20, col_values=(('external_ids', {'iface-id': '686c5c08-20e1-482b-96c2-30a6e4e99203', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:c6:45', 'vm-uuid': '2518724a-a4f8-44e6-8820-1019289e65fc'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d29db79-6a85-42cd-bb9f-09722b446e1c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: INFO os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:c6:45,bridge_name='br-int',has_traffic_filtering=True,id=686c5c08-20e1-482b-96c2-30a6e4e99203,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap686c5c08-20')
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=b6f5ddb9-961a-4001-9d43-740bc19cda82,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f5ddb9-96') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=b6f5ddb9-961a-4001-9d43-740bc19cda82,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f5ddb9-96') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6f5ddb9-96, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6f5ddb9-96, col_values=(('external_ids', {'iface-id': 'b6f5ddb9-961a-4001-9d43-740bc19cda82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:07:d2', 'vm-uuid': '2518724a-a4f8-44e6-8820-1019289e65fc'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.068s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f9ff53-2452-42df-bb53-9ce048f8db8b]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] SCSI volumes sdf have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: INFO os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=b6f5ddb9-961a-4001-9d43-740bc19cda82,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f5ddb9-96')
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:10:15,bridge_name='br-int',has_traffic_filtering=True,id=cabd5e47-5488-47f2-a96e-92de070a8267,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcabd5e47-54') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:10:15,bridge_name='br-int',has_traffic_filtering=True,id=cabd5e47-5488-47f2-a96e-92de070a8267,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcabd5e47-54') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcabd5e47-54, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcabd5e47-54, col_values=(('external_ids', {'iface-id': 'cabd5e47-5488-47f2-a96e-92de070a8267', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:10:15', 'vm-uuid': '2518724a-a4f8-44e6-8820-1019289e65fc'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e3a3f0-d19a-4f79-914d-574835a0ab6f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: INFO os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:10:15,bridge_name='br-int',has_traffic_filtering=True,id=cabd5e47-5488-47f2-a96e-92de070a8267,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcabd5e47-54')
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:14:4e,bridge_name='br-int',has_traffic_filtering=True,id=be328240-94a4-416a-97d7-e379d07e2e64,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe328240-94') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:14:4e,bridge_name='br-int',has_traffic_filtering=True,id=be328240-94a4-416a-97d7-e379d07e2e64,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe328240-94') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe328240-94, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe328240-94, col_values=(('external_ids', {'iface-id': 'be328240-94a4-416a-97d7-e379d07e2e64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:14:4e', 'vm-uuid': '2518724a-a4f8-44e6-8820-1019289e65fc'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:32 user nova-compute[70645]: WARNING nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c for instance with vm_state building and task_state spawning.
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:32 user nova-compute[70645]: WARNING nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd for instance with vm_state building and task_state spawning.
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:32 user nova-compute[70645]: WARNING nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd for instance with vm_state building and task_state spawning.
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:32 user nova-compute[70645]: WARNING nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 for instance with vm_state building and task_state spawning.
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:32 user nova-compute[70645]: WARNING nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 for instance with vm_state building and task_state spawning.
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:32 user nova-compute[70645]: WARNING nova.compute.manager [req-6f11db5f-33d3-45ae-ac49-32e4cf1eb946 req-59d1743e-2590-4c24-9c15-dd141b0a0de1 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-0204e20d-6b04-425c-9141-236a993c3d98 for instance with vm_state building and task_state spawning.
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f250fa-5ac9-4f06-a129-426f15558d42]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84, portal: 172.16.0.220,3260]
Jul 24 14:54:32 user nova-compute[70645]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84, portal: 172.16.0.220,3260] successful.
Jul 24 14:54:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: INFO os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:14:4e,bridge_name='br-int',has_traffic_filtering=True,id=be328240-94a4-416a-97d7-e379d07e2e64,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe328240-94')
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ae:82,bridge_name='br-int',has_traffic_filtering=True,id=76732353-b1bb-426d-ab39-0ccbefcef0a3,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76732353-b1') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ae:82,bridge_name='br-int',has_traffic_filtering=True,id=76732353-b1bb-426d-ab39-0ccbefcef0a3,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76732353-b1') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76732353-b1, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76732353-b1, col_values=(('external_ids', {'iface-id': '76732353-b1bb-426d-ab39-0ccbefcef0a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:ae:82', 'vm-uuid': '2518724a-a4f8-44e6-8820-1019289e65fc'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f857c39-6456-4084-84c8-e056ea580e84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbfac09-9c68-4050-aed7-9def20ca34f4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] <== disconnect_volume: return (461ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:54:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Deleting instance files /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3_del
Jul 24 14:54:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Deletion of /opt/stack/data/nova/instances/c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3_del complete
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: INFO os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ae:82,bridge_name='br-int',has_traffic_filtering=True,id=76732353-b1bb-426d-ab39-0ccbefcef0a3,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76732353-b1')
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:52:1f,bridge_name='br-int',has_traffic_filtering=True,id=0a5e5bdf-2fab-444f-ae3a-8cd841b013e9,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5e5bdf-2f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:52:1f,bridge_name='br-int',has_traffic_filtering=True,id=0a5e5bdf-2fab-444f-ae3a-8cd841b013e9,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5e5bdf-2f') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a5e5bdf-2f, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a5e5bdf-2f, col_values=(('external_ids', {'iface-id': '0a5e5bdf-2fab-444f-ae3a-8cd841b013e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:52:1f', 'vm-uuid': '2518724a-a4f8-44e6-8820-1019289e65fc'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:32 user nova-compute[70645]: INFO nova.compute.manager [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Took 1.56 seconds to destroy the instance on the hypervisor.
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: INFO os_vif [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:52:1f,bridge_name='br-int',has_traffic_filtering=True,id=0a5e5bdf-2fab-444f-ae3a-8cd841b013e9,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5e5bdf-2f')
Jul 24 14:54:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] No BDM found with device name hda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] No VIF found with MAC fa:16:3e:8d:1e:08, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] No VIF found with MAC fa:16:3e:d8:14:4e, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:54:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Using config drive
Jul 24 14:54:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Creating config drive at /opt/stack/data/nova/instances/2518724a-a4f8-44e6-8820-1019289e65fc/disk.config
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2518724a-a4f8-44e6-8820-1019289e65fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeb1h7goz {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2518724a-a4f8-44e6-8820-1019289e65fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeb1h7goz" returned: 0 in 0.053s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-4386387f-eb4f-4847-9384-9bcc0481addf req-831a2b4a-898e-41ee-8a69-3207c377faf5 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received event network-vif-deleted-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:33 user nova-compute[70645]: INFO nova.compute.manager [req-4386387f-eb4f-4847-9384-9bcc0481addf req-831a2b4a-898e-41ee-8a69-3207c377faf5 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Neutron deleted interface b181692f-4377-4a92-81ee-8d60f6fb4c96; detaching it from the instance and deleting it from the info cache
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.network.neutron [req-4386387f-eb4f-4847-9384-9bcc0481addf req-831a2b4a-898e-41ee-8a69-3207c377faf5 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:33 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Took 0.90 seconds to deallocate network for instance.
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-4386387f-eb4f-4847-9384-9bcc0481addf req-831a2b4a-898e-41ee-8a69-3207c377faf5 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Detach interface failed, port_id=b181692f-4377-4a92-81ee-8d60f6fb4c96, reason: Instance c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210473.7072706, d2c5d524-aade-4229-b12a-f953c25eaa40 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:54:33 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] VM Resumed (Lifecycle Event)
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:54:33 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Instance spawned successfully.
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:54:33 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210473.7090073, d2c5d524-aade-4229-b12a-f953c25eaa40 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:54:33 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] VM Started (Lifecycle Event)
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:54:33 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:54:33 user nova-compute[70645]: INFO nova.compute.manager [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Took 12.00 seconds to spawn the instance on the hypervisor.
Jul 24 14:54:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:54:34 user nova-compute[70645]: INFO nova.compute.manager [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Took 51.87 seconds to build instance.
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-75823331-cfc1-4309-8cec-8782a6f09ec7 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.975s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:34 user nova-compute[70645]: WARNING nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-0204e20d-6b04-425c-9141-236a993c3d98 for instance with vm_state active and task_state None.
Jul 24 14:54:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received event network-vif-unplugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Acquiring lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] No waiting events found dispatching network-vif-unplugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received event network-vif-unplugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received event network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Acquiring lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] No waiting events found dispatching network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:34 user nova-compute[70645]: WARNING nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received unexpected event network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 for instance with vm_state active and task_state deleting.
Jul 24 14:54:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received event network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Acquiring lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] No waiting events found dispatching network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:34 user nova-compute[70645]: WARNING nova.compute.manager [req-ec343ba3-8eb1-4449-b2f9-6ae7ba120b7e req-4f5a6053-6dcc-48a8-9787-984f35623718 service nova] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Received unexpected event network-vif-plugged-b181692f-4377-4a92-81ee-8d60f6fb4c96 for instance with vm_state active and task_state deleting.
Jul 24 14:54:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-a7ca20b5-2b6f-4811-b840-f36bf07db281 req-c42df973-58b1-432d-931c-9ca705b819e9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-686c5c08-20e1-482b-96c2-30a6e4e99203 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a7ca20b5-2b6f-4811-b840-f36bf07db281 req-c42df973-58b1-432d-931c-9ca705b819e9 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a7ca20b5-2b6f-4811-b840-f36bf07db281 req-c42df973-58b1-432d-931c-9ca705b819e9 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a7ca20b5-2b6f-4811-b840-f36bf07db281 req-c42df973-58b1-432d-931c-9ca705b819e9 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-a7ca20b5-2b6f-4811-b840-f36bf07db281 req-c42df973-58b1-432d-931c-9ca705b819e9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-686c5c08-20e1-482b-96c2-30a6e4e99203 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:35 user nova-compute[70645]: WARNING nova.compute.manager [req-a7ca20b5-2b6f-4811-b840-f36bf07db281 req-c42df973-58b1-432d-931c-9ca705b819e9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-686c5c08-20e1-482b-96c2-30a6e4e99203 for instance with vm_state building and task_state spawning.
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:35 user nova-compute[70645]: WARNING nova.compute.manager [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 for instance with vm_state building and task_state spawning.
Jul 24 14:54:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:35 user nova-compute[70645]: WARNING nova.compute.manager [req-5513da2c-ff02-42e0-a019-60d0d1969bf4 req-a199985f-0115-451e-9113-d34aa0d5db0e service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 for instance with vm_state building and task_state spawning.
Jul 24 14:54:35 user nova-compute[70645]: INFO nova.compute.manager [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Took 2.09 seconds to detach 1 volumes for instance.
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:35 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Deleted allocations for instance c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bb21f8d0-0a69-4cd3-9199-0826b6c18da3 tempest-DeleteServersTestJSON-2063757654 tempest-DeleteServersTestJSON-2063757654-project-member] Lock "c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.244s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-f4f6fca8-671b-4b2b-9a54-33b340f9659c req-3f1e7952-8af2-4ee1-a96c-18a2349c294f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f4f6fca8-671b-4b2b-9a54-33b340f9659c req-3f1e7952-8af2-4ee1-a96c-18a2349c294f service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f4f6fca8-671b-4b2b-9a54-33b340f9659c req-3f1e7952-8af2-4ee1-a96c-18a2349c294f service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f4f6fca8-671b-4b2b-9a54-33b340f9659c req-3f1e7952-8af2-4ee1-a96c-18a2349c294f service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-f4f6fca8-671b-4b2b-9a54-33b340f9659c req-3f1e7952-8af2-4ee1-a96c-18a2349c294f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:36 user nova-compute[70645]: WARNING nova.compute.manager [req-f4f6fca8-671b-4b2b-9a54-33b340f9659c req-3f1e7952-8af2-4ee1-a96c-18a2349c294f service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-be328240-94a4-416a-97d7-e379d07e2e64 for instance with vm_state building and task_state spawning.
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-686c5c08-20e1-482b-96c2-30a6e4e99203 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-686c5c08-20e1-482b-96c2-30a6e4e99203 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:37 user nova-compute[70645]: WARNING nova.compute.manager [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-686c5c08-20e1-482b-96c2-30a6e4e99203 for instance with vm_state building and task_state spawning.
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:37 user nova-compute[70645]: WARNING nova.compute.manager [req-a965980b-d435-4db7-84fd-37408b155323 req-8771faa2-0303-4f52-850b-8b7f6977e093 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 for instance with vm_state building and task_state spawning.
Jul 24 14:54:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:37 user nova-compute[70645]: WARNING nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 for instance with vm_state building and task_state spawning.
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:37 user nova-compute[70645]: WARNING nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 for instance with vm_state building and task_state spawning.
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:37 user nova-compute[70645]: WARNING nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-cabd5e47-5488-47f2-a96e-92de070a8267 for instance with vm_state building and task_state spawning.
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:37 user nova-compute[70645]: WARNING nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-cabd5e47-5488-47f2-a96e-92de070a8267 for instance with vm_state building and task_state spawning.
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:37 user nova-compute[70645]: WARNING nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 for instance with vm_state building and task_state spawning.
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:37 user nova-compute[70645]: WARNING nova.compute.manager [req-fa582ed2-e10c-4633-8abd-8c04e0c2af62 req-668961bf-b9c7-4027-b7df-38c1895fde3c service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 for instance with vm_state building and task_state spawning.
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:54:37 user nova-compute[70645]: INFO nova.compute.claims [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Claim successful on node user
Jul 24 14:54:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.745s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-a30e35fb-ae0f-4b3e-a3ed-4efa2e486e96 req-5f912fd2-6ead-42a9-bd6a-c57ba60d4244 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a30e35fb-ae0f-4b3e-a3ed-4efa2e486e96 req-5f912fd2-6ead-42a9-bd6a-c57ba60d4244 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a30e35fb-ae0f-4b3e-a3ed-4efa2e486e96 req-5f912fd2-6ead-42a9-bd6a-c57ba60d4244 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a30e35fb-ae0f-4b3e-a3ed-4efa2e486e96 req-5f912fd2-6ead-42a9-bd6a-c57ba60d4244 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-a30e35fb-ae0f-4b3e-a3ed-4efa2e486e96 req-5f912fd2-6ead-42a9-bd6a-c57ba60d4244 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:38 user nova-compute[70645]: WARNING nova.compute.manager [req-a30e35fb-ae0f-4b3e-a3ed-4efa2e486e96 req-5f912fd2-6ead-42a9-bd6a-c57ba60d4244 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-be328240-94a4-416a-97d7-e379d07e2e64 for instance with vm_state building and task_state spawning.
Jul 24 14:54:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG nova.network.neutron [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:54:38 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:54:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG nova.policy [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd2d003c18c4541b9c6f2ae64cc95f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b3ae943a2a40b6a83674d048fa7805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:54:38 user nova-compute[70645]: INFO nova.virt.block_device [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Booting with volume 93c54412-e306-45ab-a248-e0eafd284a4d at /dev/vda
Jul 24 14:54:38 user nova-compute[70645]: DEBUG os_brick.utils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8d3667-c53c-4b14-b3c5-7345b70545a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[18968f97-fbca-4d77-8d7a-df157b0a1b39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecad1671-362f-44d5-96ae-fc5fae387d60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3ec177-2c1d-42d5-af41-caf991c34a69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:38 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:54:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b5e79e-f330-4553-bf26-078b2775273d]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG os_brick.utils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:38 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Updating existing volume attachment record: 52460bd0-3818-410e-bdeb-72b8f0a7b06d {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210479.0851521, 2518724a-a4f8-44e6-8820-1019289e65fc => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:54:39 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] VM Resumed (Lifecycle Event)
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:54:39 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Instance spawned successfully.
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:39 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210479.086845, 2518724a-a4f8-44e6-8820-1019289e65fc => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:54:39 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] VM Started (Lifecycle Event)
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:54:39 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.network.neutron [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Successfully created port: 8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:54:39 user nova-compute[70645]: INFO nova.compute.manager [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Took 13.15 seconds to spawn the instance on the hypervisor.
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-f744fd33-547d-402d-9283-9e6de42535c7 req-eb84efd2-eba5-411a-b4df-dbbe4d5868bd service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f744fd33-547d-402d-9283-9e6de42535c7 req-eb84efd2-eba5-411a-b4df-dbbe4d5868bd service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f744fd33-547d-402d-9283-9e6de42535c7 req-eb84efd2-eba5-411a-b4df-dbbe4d5868bd service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f744fd33-547d-402d-9283-9e6de42535c7 req-eb84efd2-eba5-411a-b4df-dbbe4d5868bd service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-f744fd33-547d-402d-9283-9e6de42535c7 req-eb84efd2-eba5-411a-b4df-dbbe4d5868bd service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:39 user nova-compute[70645]: WARNING nova.compute.manager [req-f744fd33-547d-402d-9283-9e6de42535c7 req-eb84efd2-eba5-411a-b4df-dbbe4d5868bd service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 for instance with vm_state building and task_state spawning.
Jul 24 14:54:39 user nova-compute[70645]: INFO nova.compute.manager [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Took 54.69 seconds to build instance.
Jul 24 14:54:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6a472305-cbe2-4012-9dd7-7d51af4b03e2 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "2518724a-a4f8-44e6-8820-1019289e65fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 54.796s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG nova.network.neutron [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Successfully updated port: 8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG nova.compute.manager [req-b77fe72a-233c-4905-a172-7a07311c2eb5 req-5ed8980c-3d23-4d8c-bcee-6040c74d4016 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-changed-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG nova.compute.manager [req-b77fe72a-233c-4905-a172-7a07311c2eb5 req-5ed8980c-3d23-4d8c-bcee-6040c74d4016 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Refreshing instance network info cache due to event network-changed-8682dc45-20b4-4e10-aaaf-fa86015cad6b. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b77fe72a-233c-4905-a172-7a07311c2eb5 req-5ed8980c-3d23-4d8c-bcee-6040c74d4016 service nova] Acquiring lock "refresh_cache-dd796d18-9a13-40b8-9f4e-0a9dd93d4149" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b77fe72a-233c-4905-a172-7a07311c2eb5 req-5ed8980c-3d23-4d8c-bcee-6040c74d4016 service nova] Acquired lock "refresh_cache-dd796d18-9a13-40b8-9f4e-0a9dd93d4149" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG nova.network.neutron [req-b77fe72a-233c-4905-a172-7a07311c2eb5 req-5ed8980c-3d23-4d8c-bcee-6040c74d4016 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Refreshing network info cache for port 8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG nova.network.neutron [req-b77fe72a-233c-4905-a172-7a07311c2eb5 req-5ed8980c-3d23-4d8c-bcee-6040c74d4016 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "refresh_cache-dd796d18-9a13-40b8-9f4e-0a9dd93d4149" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG nova.network.neutron [req-b77fe72a-233c-4905-a172-7a07311c2eb5 req-5ed8980c-3d23-4d8c-bcee-6040c74d4016 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b77fe72a-233c-4905-a172-7a07311c2eb5 req-5ed8980c-3d23-4d8c-bcee-6040c74d4016 service nova] Releasing lock "refresh_cache-dd796d18-9a13-40b8-9f4e-0a9dd93d4149" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquired lock "refresh_cache-dd796d18-9a13-40b8-9f4e-0a9dd93d4149" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG nova.network.neutron [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG nova.network.neutron [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG nova.network.neutron [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Updating instance_info_cache with network_info: [{"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Releasing lock "refresh_cache-dd796d18-9a13-40b8-9f4e-0a9dd93d4149" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:54:40 user nova-compute[70645]: DEBUG nova.compute.manager [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Instance network_info: |[{"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:54:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-a2d0decb-4469-41ec-b60c-3ef30c4abdc2 req-ba3beadd-e4fb-4c34-a5ec-5abd16828710 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Received event network-changed-014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-a2d0decb-4469-41ec-b60c-3ef30c4abdc2 req-ba3beadd-e4fb-4c34-a5ec-5abd16828710 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Refreshing instance network info cache due to event network-changed-014795b1-c234-4335-acff-79b1fbab054f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:54:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a2d0decb-4469-41ec-b60c-3ef30c4abdc2 req-ba3beadd-e4fb-4c34-a5ec-5abd16828710 service nova] Acquiring lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:54:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a2d0decb-4469-41ec-b60c-3ef30c4abdc2 req-ba3beadd-e4fb-4c34-a5ec-5abd16828710 service nova] Acquired lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:54:43 user nova-compute[70645]: DEBUG nova.network.neutron [req-a2d0decb-4469-41ec-b60c-3ef30c4abdc2 req-ba3beadd-e4fb-4c34-a5ec-5abd16828710 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Refreshing network info cache for port 014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:54:44 user nova-compute[70645]: DEBUG nova.network.neutron [req-a2d0decb-4469-41ec-b60c-3ef30c4abdc2 req-ba3beadd-e4fb-4c34-a5ec-5abd16828710 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Updated VIF entry in instance network info cache for port 014795b1-c234-4335-acff-79b1fbab054f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:54:44 user nova-compute[70645]: DEBUG nova.network.neutron [req-a2d0decb-4469-41ec-b60c-3ef30c4abdc2 req-ba3beadd-e4fb-4c34-a5ec-5abd16828710 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Updating instance_info_cache with network_info: [{"id": "014795b1-c234-4335-acff-79b1fbab054f", "address": "fa:16:3e:4d:44:3f", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014795b1-c2", "ovs_interfaceid": "014795b1-c234-4335-acff-79b1fbab054f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a2d0decb-4469-41ec-b60c-3ef30c4abdc2 req-ba3beadd-e4fb-4c34-a5ec-5abd16828710 service nova] Releasing lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:54:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-5b80533b-b81c-46b2-b315-88b4b47cf3a3 req-cf33c4cf-ba87-49b7-99f4-cb68f2659af3 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Received event network-changed-24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-5b80533b-b81c-46b2-b315-88b4b47cf3a3 req-cf33c4cf-ba87-49b7-99f4-cb68f2659af3 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Refreshing instance network info cache due to event network-changed-24dcb843-5910-4f0c-bace-e9b24f5536a8. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:54:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5b80533b-b81c-46b2-b315-88b4b47cf3a3 req-cf33c4cf-ba87-49b7-99f4-cb68f2659af3 service nova] Acquiring lock "refresh_cache-ea55b3b9-4821-4400-b99f-ba233c2a7395" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:54:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5b80533b-b81c-46b2-b315-88b4b47cf3a3 req-cf33c4cf-ba87-49b7-99f4-cb68f2659af3 service nova] Acquired lock "refresh_cache-ea55b3b9-4821-4400-b99f-ba233c2a7395" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:54:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-5b80533b-b81c-46b2-b315-88b4b47cf3a3 req-cf33c4cf-ba87-49b7-99f4-cb68f2659af3 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Refreshing network info cache for port 24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:54:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-5b80533b-b81c-46b2-b315-88b4b47cf3a3 req-cf33c4cf-ba87-49b7-99f4-cb68f2659af3 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Updated VIF entry in instance network info cache for port 24dcb843-5910-4f0c-bace-e9b24f5536a8. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:54:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-5b80533b-b81c-46b2-b315-88b4b47cf3a3 req-cf33c4cf-ba87-49b7-99f4-cb68f2659af3 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Updating instance_info_cache with network_info: [{"id": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "address": "fa:16:3e:ef:95:ba", "network": {"id": "8fb8583c-cd2f-4a58-96b5-8fe7c93535a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-455369873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f383c938a0a44aa994cf1d464f94e34d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24dcb843-59", "ovs_interfaceid": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5b80533b-b81c-46b2-b315-88b4b47cf3a3 req-cf33c4cf-ba87-49b7-99f4-cb68f2659af3 service nova] Releasing lock "refresh_cache-ea55b3b9-4821-4400-b99f-ba233c2a7395" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:54:46 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210471.711966, c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:54:46 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] VM Stopped (Lifecycle Event)
Jul 24 14:54:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ceb2aa93-d058-4652-b92a-4935bc1c9fe4 None None] [instance: c7c29ca0-c424-4ad9-afed-94a0a3d1c3c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:54:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "f1a667e2-7992-44e4-9500-fa598493e173" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lazy-loading 'flavor' on Instance uuid f1a667e2-7992-44e4-9500-fa598493e173 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "f1a667e2-7992-44e4-9500-fa598493e173" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:47 user nova-compute[70645]: INFO nova.compute.manager [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Attaching volume 0fb4f199-da3f-4814-8d6e-a53bf0ed284f to /dev/vdb
Jul 24 14:54:47 user nova-compute[70645]: DEBUG os_brick.utils [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f92936-8b71-41b9-b488-00cf47a646b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ab24fe-4cd1-428a-b8d8-b154f68afff4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b99163-a031-4cb1-a481-143c4fbec0ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfc6583-a537-4763-9d77-6581b440ed58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:47 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:54:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b82f07-a205-47f4-b774-977e6b763e3e]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG os_brick.utils [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:47 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Updating existing volume attachment record: 78cba139-a477-41a5-a1ff-13a6fa79affa {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:54:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Creating image(s)
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Ensure instance console log exists: /opt/stack/data/nova/instances/dd796d18-9a13-40b8-9f4e-0a9dd93d4149/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.006s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Start _get_guest_xml network_info=[{"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '52460bd0-3818-410e-bdeb-72b8f0a7b06d', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCvVFDMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd796d18-9a13-40b8-9f4e-0a9dd93d4149', 'attached_at': '', 'detached_at': '', 'volume_id': '93c54412-e306-45ab-a248-e0eafd284a4d', 'serial': '93c54412-e306-45ab-a248-e0eafd284a4d'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:54:48 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:54:48 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCvVFDMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:48 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:48 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:48 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2144066-17c0-4eb5-b0dc-02f736b84e5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:54:48 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f52837-bddd-4e9f-8824-739d646429bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d] added
Jul 24 14:54:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f477f64f-1d6a-4600-aabb-3230e8150ffd]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[05deb9e5-3e8c-4bab-8dac-4fa2012b60e0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCvVFDMu {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCvVFDMu" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e5afbd-a5a9-4d51-bf7b-896ea2f17079]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sCvVFDMu'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5ba257-cf59-42f9-943c-fca2aeff8be6]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2c6513-1f83-4906-ae96-449b9c98c347]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8840fd-b723-4fab-b457-a51dcb427cdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260]
Jul 24 14:54:48 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260] successful.
Jul 24 14:54:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ba9c92-8af6-4291-972a-b9ca2afa7cb2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a9485c-6424-4404-8bb4-cf010d34e570]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:54:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:48 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:54:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cb2cb7-bf67-4b49-b229-6fbfeeec3ec1]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:54:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCvVFDMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG nova.objects.instance [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lazy-loading 'flavor' on Instance uuid ea55b3b9-4821-4400-b99f-ba233c2a7395 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:49 user nova-compute[70645]: INFO nova.compute.manager [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Attaching volume 6723f311-e54a-4cc9-afc3-3f222a86af55 to /dev/sdc
Jul 24 14:54:49 user nova-compute[70645]: DEBUG os_brick.utils [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[540005e2-f925-4c39-aa1d-35d58fdb60f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6209e6-f2fb-4030-a680-1858848f2d0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7357c2-0df5-4591-9ee7-9d5d5ee25e61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[43827d01-ef87-4e95-b93a-994a7c3c9ed3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:49 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:54:49 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a78e192-992c-4c38-ad79-fbfb1b9c1208]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG os_brick.utils [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Updating existing volume attachment record: 2271e348-74b9-44b3-a63c-09c413fda08c {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23632653038636636', 'path': '/dev/sdf'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632653038636636', 'path': '/dev/sdf'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-688018022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-688018022',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwoqgcpuew/lBL0A4HvDTZZKuMR4W08vCGF6DHg1WPwF1CRmpQpivSWEIG4F/2elmJ0HJ8+k9QG4CGPETqeUnBFSkbmxAYPCMF6V6tJyegjLzXd8TOfUwgbFBlNNmwaPA==',key_name='tempest-keypair-1741933867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31b3ae943a2a40b6a83674d048fa7805',ramdisk_id='',reservation_id='r-9kpb6uxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-870483127',owner_user_name='tempest-ServerActionsV293TestJSON-870483127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd2d003c18c4541b9c6f2ae64cc95f6',uuid=dd796d18-9a13-40b8-9f4e-0a9dd93d4149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converting VIF {"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG nova.objects.instance [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lazy-loading 'pci_devices' on Instance uuid dd796d18-9a13-40b8-9f4e-0a9dd93d4149 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:54:50 user nova-compute[70645]:   <uuid>dd796d18-9a13-40b8-9f4e-0a9dd93d4149</uuid>
Jul 24 14:54:50 user nova-compute[70645]:   <name>instance-0000000b</name>
Jul 24 14:54:50 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:54:50 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:54:50 user nova-compute[70645]:   <metadata>
Jul 24 14:54:50 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:54:50 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:54:50 user nova-compute[70645]:       <nova:name>tempest-ServerActionsV293TestJSON-server-688018022</nova:name>
Jul 24 14:54:50 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:54:48</nova:creationTime>
Jul 24 14:54:50 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:54:50 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:54:50 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:54:50 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:54:50 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:54:50 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:54:50 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:54:50 user nova-compute[70645]:       <nova:owner>
Jul 24 14:54:50 user nova-compute[70645]:         <nova:user uuid="bcd2d003c18c4541b9c6f2ae64cc95f6">tempest-ServerActionsV293TestJSON-870483127-project-member</nova:user>
Jul 24 14:54:50 user nova-compute[70645]:         <nova:project uuid="31b3ae943a2a40b6a83674d048fa7805">tempest-ServerActionsV293TestJSON-870483127</nova:project>
Jul 24 14:54:50 user nova-compute[70645]:       </nova:owner>
Jul 24 14:54:50 user nova-compute[70645]:       <nova:ports>
Jul 24 14:54:50 user nova-compute[70645]:         <nova:port uuid="8682dc45-20b4-4e10-aaaf-fa86015cad6b">
Jul 24 14:54:50 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 14:54:50 user nova-compute[70645]:         </nova:port>
Jul 24 14:54:50 user nova-compute[70645]:       </nova:ports>
Jul 24 14:54:50 user nova-compute[70645]:     </nova:instance>
Jul 24 14:54:50 user nova-compute[70645]:   </metadata>
Jul 24 14:54:50 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:54:50 user nova-compute[70645]:     <system>
Jul 24 14:54:50 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:54:50 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:54:50 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:54:50 user nova-compute[70645]:       <entry name="serial">dd796d18-9a13-40b8-9f4e-0a9dd93d4149</entry>
Jul 24 14:54:50 user nova-compute[70645]:       <entry name="uuid">dd796d18-9a13-40b8-9f4e-0a9dd93d4149</entry>
Jul 24 14:54:50 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:54:50 user nova-compute[70645]:     </system>
Jul 24 14:54:50 user nova-compute[70645]:   </sysinfo>
Jul 24 14:54:50 user nova-compute[70645]:   <os>
Jul 24 14:54:50 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:54:50 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:54:50 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:54:50 user nova-compute[70645]:   </os>
Jul 24 14:54:50 user nova-compute[70645]:   <features>
Jul 24 14:54:50 user nova-compute[70645]:     <acpi/>
Jul 24 14:54:50 user nova-compute[70645]:     <apic/>
Jul 24 14:54:50 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:54:50 user nova-compute[70645]:   </features>
Jul 24 14:54:50 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:54:50 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:54:50 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:54:50 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:54:50 user nova-compute[70645]:   </clock>
Jul 24 14:54:50 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:54:50 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:54:50 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:54:50 user nova-compute[70645]:   </cpu>
Jul 24 14:54:50 user nova-compute[70645]:   <devices>
Jul 24 14:54:50 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 14:54:50 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:54:50 user nova-compute[70645]:       <source dev="/dev/sdf"/>
Jul 24 14:54:50 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:54:50 user nova-compute[70645]:       <serial>93c54412-e306-45ab-a248-e0eafd284a4d</serial>
Jul 24 14:54:50 user nova-compute[70645]:     </disk>
Jul 24 14:54:50 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:54:50 user nova-compute[70645]:       <mac address="fa:16:3e:ea:18:90"/>
Jul 24 14:54:50 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:50 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:54:50 user nova-compute[70645]:       <target dev="tap8682dc45-20"/>
Jul 24 14:54:50 user nova-compute[70645]:     </interface>
Jul 24 14:54:50 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:54:50 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/dd796d18-9a13-40b8-9f4e-0a9dd93d4149/console.log" append="off"/>
Jul 24 14:54:50 user nova-compute[70645]:     </serial>
Jul 24 14:54:50 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:54:50 user nova-compute[70645]:     <video>
Jul 24 14:54:50 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:54:50 user nova-compute[70645]:     </video>
Jul 24 14:54:50 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:54:50 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:54:50 user nova-compute[70645]:     </rng>
Jul 24 14:54:50 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:54:50 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:54:50 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:54:50 user nova-compute[70645]:     </memballoon>
Jul 24 14:54:50 user nova-compute[70645]:   </devices>
Jul 24 14:54:50 user nova-compute[70645]: </domain>
Jul 24 14:54:50 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-688018022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-688018022',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwoqgcpuew/lBL0A4HvDTZZKuMR4W08vCGF6DHg1WPwF1CRmpQpivSWEIG4F/2elmJ0HJ8+k9QG4CGPETqeUnBFSkbmxAYPCMF6V6tJyegjLzXd8TOfUwgbFBlNNmwaPA==',key_name='tempest-keypair-1741933867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31b3ae943a2a40b6a83674d048fa7805',ramdisk_id='',reservation_id='r-9kpb6uxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-870483127',owner_user_name='tempest-ServerActionsV293TestJSON-870483127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd2d003c18c4541b9c6f2ae64cc95f6',uuid=dd796d18-9a13-40b8-9f4e-0a9dd93d4149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converting VIF {"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG os_vif [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8682dc45-20, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8682dc45-20, col_values=(('external_ids', {'iface-id': '8682dc45-20b4-4e10-aaaf-fa86015cad6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:18:90', 'vm-uuid': 'dd796d18-9a13-40b8-9f4e-0a9dd93d4149'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:50 user nova-compute[70645]: INFO os_vif [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20')
Jul 24 14:54:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:54:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] No VIF found with MAC fa:16:3e:ea:18:90, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-4ef25980-53a3-46fd-83b6-f8c590b98a15 req-42f67557-3f57-4c2a-a75d-038911d854ac service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Received event network-changed-ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-4ef25980-53a3-46fd-83b6-f8c590b98a15 req-42f67557-3f57-4c2a-a75d-038911d854ac service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Refreshing instance network info cache due to event network-changed-ca039191-1724-4ec8-ac6f-0264f8d8c7ff. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4ef25980-53a3-46fd-83b6-f8c590b98a15 req-42f67557-3f57-4c2a-a75d-038911d854ac service nova] Acquiring lock "refresh_cache-a816f335-7f2e-4121-9667-237b22349724" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4ef25980-53a3-46fd-83b6-f8c590b98a15 req-42f67557-3f57-4c2a-a75d-038911d854ac service nova] Acquired lock "refresh_cache-a816f335-7f2e-4121-9667-237b22349724" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG nova.network.neutron [req-4ef25980-53a3-46fd-83b6-f8c590b98a15 req-42f67557-3f57-4c2a-a75d-038911d854ac service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Refreshing network info cache for port ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG nova.objects.instance [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lazy-loading 'flavor' on Instance uuid a816f335-7f2e-4121-9667-237b22349724 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:51 user nova-compute[70645]: INFO nova.compute.manager [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Attaching volume 317500b2-0855-4b5d-8697-2df652366e5d to /dev/vdb
Jul 24 14:54:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG os_brick.utils [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-ef4783fc-b9d7-4c25-8a43-6ec0a8f62977 req-ffd0942e-0648-4eaa-8d7a-a490b3a923e7 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ef4783fc-b9d7-4c25-8a43-6ec0a8f62977 req-ffd0942e-0648-4eaa-8d7a-a490b3a923e7 service nova] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ef4783fc-b9d7-4c25-8a43-6ec0a8f62977 req-ffd0942e-0648-4eaa-8d7a-a490b3a923e7 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ef4783fc-b9d7-4c25-8a43-6ec0a8f62977 req-ffd0942e-0648-4eaa-8d7a-a490b3a923e7 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-ef4783fc-b9d7-4c25-8a43-6ec0a8f62977 req-ffd0942e-0648-4eaa-8d7a-a490b3a923e7 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] No waiting events found dispatching network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:52 user nova-compute[70645]: WARNING nova.compute.manager [req-ef4783fc-b9d7-4c25-8a43-6ec0a8f62977 req-ffd0942e-0648-4eaa-8d7a-a490b3a923e7 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received unexpected event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b for instance with vm_state building and task_state spawning.
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[29971d34-482d-4f7d-bb16-8cdce6b16ce9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ace2560-edc5-4f1b-a409-0af1b33dc5f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[566a7f1f-e29a-46f5-9b32-c7c23b083dfe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e68e957-189c-4243-a6d8-7a7eeb8b331a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:52 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1c62e5-ce29-4377-a001-68fe66a17e98]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG os_brick.utils [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Updating existing volume attachment record: c2e296fe-9eb6-4573-abfc-163f70a57391 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-4ef25980-53a3-46fd-83b6-f8c590b98a15 req-42f67557-3f57-4c2a-a75d-038911d854ac service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Updated VIF entry in instance network info cache for port ca039191-1724-4ec8-ac6f-0264f8d8c7ff. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-4ef25980-53a3-46fd-83b6-f8c590b98a15 req-42f67557-3f57-4c2a-a75d-038911d854ac service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Updating instance_info_cache with network_info: [{"id": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "address": "fa:16:3e:6a:c6:57", "network": {"id": "757b79f5-32d3-4ac1-8283-6b1ea3b657b1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508181088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e80c8a86e44f3f9d5a84c24675a8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca039191-17", "ovs_interfaceid": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4ef25980-53a3-46fd-83b6-f8c590b98a15 req-42f67557-3f57-4c2a-a75d-038911d854ac service nova] Releasing lock "refresh_cache-a816f335-7f2e-4121-9667-237b22349724" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "interface-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "interface-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG nova.objects.instance [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lazy-loading 'flavor' on Instance uuid 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-fd162dc1-643b-428b-b2d2-ed8234e56419 req-e3660929-5940-4ef1-8c39-967ff56935fa service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-changed-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-fd162dc1-643b-428b-b2d2-ed8234e56419 req-e3660929-5940-4ef1-8c39-967ff56935fa service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Refreshing instance network info cache due to event network-changed-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd162dc1-643b-428b-b2d2-ed8234e56419 req-e3660929-5940-4ef1-8c39-967ff56935fa service nova] Acquiring lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd162dc1-643b-428b-b2d2-ed8234e56419 req-e3660929-5940-4ef1-8c39-967ff56935fa service nova] Acquired lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG nova.network.neutron [req-fd162dc1-643b-428b-b2d2-ed8234e56419 req-e3660929-5940-4ef1-8c39-967ff56935fa service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Refreshing network info cache for port bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG nova.objects.instance [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lazy-loading 'pci_requests' on Instance uuid 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG nova.policy [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28e6065f28da456b888cc801f7561b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e96ad4dba143709ad8715dea63bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:54:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.network.neutron [req-fd162dc1-643b-428b-b2d2-ed8234e56419 req-e3660929-5940-4ef1-8c39-967ff56935fa service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updated VIF entry in instance network info cache for port bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.network.neutron [req-fd162dc1-643b-428b-b2d2-ed8234e56419 req-e3660929-5940-4ef1-8c39-967ff56935fa service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updating instance_info_cache with network_info: [{"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd162dc1-643b-428b-b2d2-ed8234e56419 req-e3660929-5940-4ef1-8c39-967ff56935fa service nova] Releasing lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-82764e38-3816-451c-bbf6-461f020c454e req-2927b2c2-a737-4336-9397-4e2de960f3e2 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-82764e38-3816-451c-bbf6-461f020c454e req-2927b2c2-a737-4336-9397-4e2de960f3e2 service nova] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-82764e38-3816-451c-bbf6-461f020c454e req-2927b2c2-a737-4336-9397-4e2de960f3e2 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-82764e38-3816-451c-bbf6-461f020c454e req-2927b2c2-a737-4336-9397-4e2de960f3e2 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-82764e38-3816-451c-bbf6-461f020c454e req-2927b2c2-a737-4336-9397-4e2de960f3e2 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] No waiting events found dispatching network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:54 user nova-compute[70645]: WARNING nova.compute.manager [req-82764e38-3816-451c-bbf6-461f020c454e req-2927b2c2-a737-4336-9397-4e2de960f3e2 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received unexpected event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b for instance with vm_state building and task_state spawning.
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Successfully created port: d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210494.373117, dd796d18-9a13-40b8-9f4e-0a9dd93d4149 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:54:54 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] VM Resumed (Lifecycle Event)
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:54:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Instance spawned successfully.
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:54:54 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210494.3810565, dd796d18-9a13-40b8-9f4e-0a9dd93d4149 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:54:54 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] VM Started (Lifecycle Event)
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:54:54 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:54:54 user nova-compute[70645]: INFO nova.compute.manager [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Took 6.10 seconds to spawn the instance on the hypervisor.
Jul 24 14:54:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:54:54 user nova-compute[70645]: INFO nova.compute.manager [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Took 17.12 seconds to build instance.
Jul 24 14:54:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-741759ff-3e7f-4500-b983-937194284ee9 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.266s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Successfully updated port: d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:54:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:54:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquired lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:54:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:54:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-429c642b-425b-48f3-9688-10fa49a01326 req-d6e95c22-958b-4166-af08-d503e0fedd94 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-changed-d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-429c642b-425b-48f3-9688-10fa49a01326 req-d6e95c22-958b-4166-af08-d503e0fedd94 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Refreshing instance network info cache due to event network-changed-d86fc3c3-4140-4680-b72b-439583652c7f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:54:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-429c642b-425b-48f3-9688-10fa49a01326 req-d6e95c22-958b-4166-af08-d503e0fedd94 service nova] Acquiring lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updating instance_info_cache with network_info: [{"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d86fc3c3-4140-4680-b72b-439583652c7f", "address": "fa:16:3e:61:23:bd", "network": {"id": "c7f79393-5e5e-48f8-999f-b74a41796eed", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1611956044", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86fc3c3-41", "ovs_interfaceid": "d86fc3c3-4140-4680-b72b-439583652c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Releasing lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-429c642b-425b-48f3-9688-10fa49a01326 req-d6e95c22-958b-4166-af08-d503e0fedd94 service nova] Acquired lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG nova.network.neutron [req-429c642b-425b-48f3-9688-10fa49a01326 req-d6e95c22-958b-4166-af08-d503e0fedd94 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Refreshing network info cache for port d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-896493417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-896493417',id=8,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOC+pbtS3b10zgGPN8jzEAGTj3Lutj6NjqD/u3q2th61GdXcNYKMiu+ZkghxLk9jByTpKK5pKCNa5736mrWQiHDLOInWyMhYDKqT7SxK/aJuuMMC5WiwiwkOIdnj15Mqg==',key_name='tempest-keypair-1737242635',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7e96ad4dba143709ad8715dea63bf23',ramdisk_id='',reservation_id='r-wle60jho',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-813130247',owner_user_name='tempest-TaggedAttachmentsTest-813130247-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28e6065f28da456b888cc801f7561b85',uuid=5f355cfc-9d1b-4f2b-936b-e28a65bd99e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d86fc3c3-4140-4680-b72b-439583652c7f", "address": "fa:16:3e:61:23:bd", "network": {"id": "c7f79393-5e5e-48f8-999f-b74a41796eed", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1611956044", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86fc3c3-41", "ovs_interfaceid": "d86fc3c3-4140-4680-b72b-439583652c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converting VIF {"id": "d86fc3c3-4140-4680-b72b-439583652c7f", "address": "fa:16:3e:61:23:bd", "network": {"id": "c7f79393-5e5e-48f8-999f-b74a41796eed", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1611956044", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86fc3c3-41", "ovs_interfaceid": "d86fc3c3-4140-4680-b72b-439583652c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:23:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86fc3c3-4140-4680-b72b-439583652c7f,network=Network(c7f79393-5e5e-48f8-999f-b74a41796eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86fc3c3-41') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG os_vif [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:23:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86fc3c3-4140-4680-b72b-439583652c7f,network=Network(c7f79393-5e5e-48f8-999f-b74a41796eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86fc3c3-41') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd86fc3c3-41, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd86fc3c3-41, col_values=(('external_ids', {'iface-id': 'd86fc3c3-4140-4680-b72b-439583652c7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:23:bd', 'vm-uuid': '5f355cfc-9d1b-4f2b-936b-e28a65bd99e1'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:56 user nova-compute[70645]: INFO os_vif [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:23:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86fc3c3-4140-4680-b72b-439583652c7f,network=Network(c7f79393-5e5e-48f8-999f-b74a41796eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86fc3c3-41')
Jul 24 14:54:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-896493417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-896493417',id=8,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOC+pbtS3b10zgGPN8jzEAGTj3Lutj6NjqD/u3q2th61GdXcNYKMiu+ZkghxLk9jByTpKK5pKCNa5736mrWQiHDLOInWyMhYDKqT7SxK/aJuuMMC5WiwiwkOIdnj15Mqg==',key_name='tempest-keypair-1737242635',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7e96ad4dba143709ad8715dea63bf23',ramdisk_id='',reservation_id='r-wle60jho',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-813130247',owner_user_name='tempest-TaggedAttachmentsTest-813130247-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28e6065f28da456b888cc801f7561b85',uuid=5f355cfc-9d1b-4f2b-936b-e28a65bd99e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d86fc3c3-4140-4680-b72b-439583652c7f", "address": "fa:16:3e:61:23:bd", "network": {"id": "c7f79393-5e5e-48f8-999f-b74a41796eed", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1611956044", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86fc3c3-41", "ovs_interfaceid": "d86fc3c3-4140-4680-b72b-439583652c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converting VIF {"id": "d86fc3c3-4140-4680-b72b-439583652c7f", "address": "fa:16:3e:61:23:bd", "network": {"id": "c7f79393-5e5e-48f8-999f-b74a41796eed", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1611956044", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86fc3c3-41", "ovs_interfaceid": "d86fc3c3-4140-4680-b72b-439583652c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:23:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86fc3c3-4140-4680-b72b-439583652c7f,network=Network(c7f79393-5e5e-48f8-999f-b74a41796eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86fc3c3-41') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] attach device xml: <interface type="ethernet">
Jul 24 14:54:56 user nova-compute[70645]:   <mac address="fa:16:3e:61:23:bd"/>
Jul 24 14:54:56 user nova-compute[70645]:   <model type="virtio"/>
Jul 24 14:54:56 user nova-compute[70645]:   <mtu size="1442"/>
Jul 24 14:54:56 user nova-compute[70645]:   <target dev="tapd86fc3c3-41"/>
Jul 24 14:54:56 user nova-compute[70645]: </interface>
Jul 24 14:54:56 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] No BDM found with device name hda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] No VIF found with MAC fa:16:3e:32:d0:25, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:54:57 user nova-compute[70645]:   <nova:package version="0.0.0"/>
Jul 24 14:54:57 user nova-compute[70645]:   <nova:name>tempest-device-tagging-server-896493417</nova:name>
Jul 24 14:54:57 user nova-compute[70645]:   <nova:creationTime>2023-07-24 14:54:57</nova:creationTime>
Jul 24 14:54:57 user nova-compute[70645]:   <nova:flavor name="m1.tiny">
Jul 24 14:54:57 user nova-compute[70645]:     <nova:memory>512</nova:memory>
Jul 24 14:54:57 user nova-compute[70645]:     <nova:disk>1</nova:disk>
Jul 24 14:54:57 user nova-compute[70645]:     <nova:swap>0</nova:swap>
Jul 24 14:54:57 user nova-compute[70645]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:54:57 user nova-compute[70645]:     <nova:vcpus>1</nova:vcpus>
Jul 24 14:54:57 user nova-compute[70645]:   </nova:flavor>
Jul 24 14:54:57 user nova-compute[70645]:   <nova:owner>
Jul 24 14:54:57 user nova-compute[70645]:     <nova:user uuid="28e6065f28da456b888cc801f7561b85">tempest-TaggedAttachmentsTest-813130247-project-member</nova:user>
Jul 24 14:54:57 user nova-compute[70645]:     <nova:project uuid="b7e96ad4dba143709ad8715dea63bf23">tempest-TaggedAttachmentsTest-813130247</nova:project>
Jul 24 14:54:57 user nova-compute[70645]:   </nova:owner>
Jul 24 14:54:57 user nova-compute[70645]:   <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:54:57 user nova-compute[70645]:   <nova:ports>
Jul 24 14:54:57 user nova-compute[70645]:     <nova:port uuid="bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1">
Jul 24 14:54:57 user nova-compute[70645]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 14:54:57 user nova-compute[70645]:     </nova:port>
Jul 24 14:54:57 user nova-compute[70645]:     <nova:port uuid="d86fc3c3-4140-4680-b72b-439583652c7f">
Jul 24 14:54:57 user nova-compute[70645]:       <nova:ip type="fixed" address="10.10.10.79" ipVersion="4"/>
Jul 24 14:54:57 user nova-compute[70645]:     </nova:port>
Jul 24 14:54:57 user nova-compute[70645]:   </nova:ports>
Jul 24 14:54:57 user nova-compute[70645]: </nova:instance>
Jul 24 14:54:57 user nova-compute[70645]:  {{(pid=70645) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-cc84a0a2-887b-4ccf-8883-1cd527e63fb7 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "interface-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.950s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.network.neutron [req-429c642b-425b-48f3-9688-10fa49a01326 req-d6e95c22-958b-4166-af08-d503e0fedd94 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updated VIF entry in instance network info cache for port d86fc3c3-4140-4680-b72b-439583652c7f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.network.neutron [req-429c642b-425b-48f3-9688-10fa49a01326 req-d6e95c22-958b-4166-af08-d503e0fedd94 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updating instance_info_cache with network_info: [{"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d86fc3c3-4140-4680-b72b-439583652c7f", "address": "fa:16:3e:61:23:bd", "network": {"id": "c7f79393-5e5e-48f8-999f-b74a41796eed", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1611956044", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86fc3c3-41", "ovs_interfaceid": "d86fc3c3-4140-4680-b72b-439583652c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-429c642b-425b-48f3-9688-10fa49a01326 req-d6e95c22-958b-4166-af08-d503e0fedd94 service nova] Releasing lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:54:57 user nova-compute[70645]: INFO nova.compute.claims [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Claim successful on node user
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dltgeNKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:57 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:57 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:54:57 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4a313a-f360-4372-9a89-e560e6dffd2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:54:57 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[88227c2a-1a0f-4dfd-ab6d-58f37fc49169]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f] added
Jul 24 14:54:57 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe517414-b2f7-4185-b00d-b98d46fb98d5]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f8c3f1-0906-4e9d-be90-0edd7b776c1e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-vif-plugged-d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] No waiting events found dispatching network-vif-plugged-d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:57 user nova-compute[70645]: WARNING nova.compute.manager [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received unexpected event network-vif-plugged-d86fc3c3-4140-4680-b72b-439583652c7f for instance with vm_state active and task_state None.
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-vif-plugged-d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] No waiting events found dispatching network-vif-plugged-d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:54:57 user nova-compute[70645]: WARNING nova.compute.manager [req-167c0f3d-9d71-443c-aeb8-07e7cfda7722 req-029c087f-3160-4554-8537-9a615c2bb847 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received unexpected event network-vif-plugged-d86fc3c3-4140-4680-b72b-439583652c7f for instance with vm_state active and task_state None.
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dltgeNKo {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dltgeNKo" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fac6f1-88d9-4b3e-ba24-279e6ee8af70]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dltgeNKo'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ecd604-38be-47dd-b134-c8630c97d5d8]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c8a899-5c1c-42f5-a96a-643048c0931b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:54:57 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:57 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:54:57 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edd147f-d5ca-4d7b-9b19-9b478cf27f5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f, portal: 172.16.0.220,3260]
Jul 24 14:54:58 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f, portal: 172.16.0.220,3260] successful.
Jul 24 14:54:58 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e29c00-4257-44e1-b053-57c1628ba06e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lazy-loading 'flavor' on Instance uuid 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8416bc-9c3e-4e70-96a0-a2d326dde548]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:54:58 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:54:58 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:54:58 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e683ea-17fa-41ef-a52b-7c80d726f55f]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dltgeNKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.702s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:58 user nova-compute[70645]: INFO nova.compute.manager [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Attaching volume 79e20d09-7ee7-4d94-bc9c-48c2ac86c72b to /dev/vdb
Jul 24 14:54:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:54:58 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:54:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.utils [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a45787-4716-48fa-b56f-346e9cb1e654]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a3d0b2-c3cb-4749-ae0a-8b87ef3837de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fc52e1-31cf-4a06-9ab5-f4bb5050070b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d1408a-9560-489e-b985-b266e2d419ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG nova.policy [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c802a14cf1642aaa356c481fe000696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '603f18c021ae49fab9aaaa4b5f1fa780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:54:58 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Creating image(s)
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "/opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "/opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:54:58 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2789cad-7b4a-4cad-a0ad-6bb2fca9f8a2]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG os_brick.utils [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] <== get_connector_properties: return (217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updating existing volume attachment record: b94d8943-3848-4300-900a-5c005772a6cc {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.173s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.177s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk 1073741824" returned: 0 in 0.055s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] <== connect_volume: return (1515ms) {'type': 'block', 'scsi_wwn': '26334383362623139', 'path': '/dev/sdi'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334383362623139', 'path': '/dev/sdi'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lazy-loading 'flavor' on Instance uuid f1a667e2-7992-44e4-9500-fa598493e173 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 14:54:59 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:54:59 user nova-compute[70645]:   <source dev="/dev/sdi"/>
Jul 24 14:54:59 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:54:59 user nova-compute[70645]:   <serial>0fb4f199-da3f-4814-8d6e-a53bf0ed284f</serial>
Jul 24 14:54:59 user nova-compute[70645]: </disk>
Jul 24 14:54:59 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.185s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Cannot resize image /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG nova.objects.instance [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lazy-loading 'migration_context' on Instance uuid ff0bb392-a296-45a0-a102-f8b0e1c9d41a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Ensure instance console log exists: /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:54:59 user nova-compute[70645]: DEBUG nova.network.neutron [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Successfully created port: ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] No VIF found with MAC fa:16:3e:4d:44:3f, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmETPLiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:00 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:00 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:00 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbb8a98-0fe1-48a2-aa7e-d16dd5d8546c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:55:00 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2781ec6-de77-405c-80cf-7cbbf6157552]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55] added
Jul 24 14:55:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5b3afc-3a4b-4ea4-b972-9259cd762af6]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d06915e-11ca-41cd-807d-8709c07267b4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmETPLiu {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmETPLiu" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[56794991-6af7-43c2-b3c6-faf04efae35d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmETPLiu'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aabb21-bc51-443a-a9ca-8791a1a36077]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09811a8-8307-4a5f-90e7-9cf3cc387fba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f9078df2-3672-4beb-8499-0318f75ff717 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.601s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92f89c0-4af2-4f8c-9a21-826261205b36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55, portal: 172.16.0.220,3260]
Jul 24 14:55:00 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef98590-9f23-4ba0-bcbe-7e2db8acb788]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ece242e-d631-4cce-aff8-63904cdde1a2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:00 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[25672eef-6bca-48e0-b70e-c9229c3fa754]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmETPLiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Successfully updated port: ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "refresh_cache-ff0bb392-a296-45a0-a102-f8b0e1c9d41a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquired lock "refresh_cache-ff0bb392-a296-45a0-a102-f8b0e1c9d41a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-daae61a1-58af-4d37-bdcb-0204bd76ad61 req-b4db9189-8353-4a21-8fb4-cb9da8088a47 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Received event network-changed-ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-daae61a1-58af-4d37-bdcb-0204bd76ad61 req-b4db9189-8353-4a21-8fb4-cb9da8088a47 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Refreshing instance network info cache due to event network-changed-ffd805b9-7af4-452a-96ba-8abd05010a47. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-daae61a1-58af-4d37-bdcb-0204bd76ad61 req-b4db9189-8353-4a21-8fb4-cb9da8088a47 service nova] Acquiring lock "refresh_cache-ff0bb392-a296-45a0-a102-f8b0e1c9d41a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Updating instance_info_cache with network_info: [{"id": "ffd805b9-7af4-452a-96ba-8abd05010a47", "address": "fa:16:3e:22:c2:66", "network": {"id": "7d870511-075a-4fa7-83ef-9147e626f8f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1824197985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603f18c021ae49fab9aaaa4b5f1fa780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd805b9-7a", "ovs_interfaceid": "ffd805b9-7af4-452a-96ba-8abd05010a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Releasing lock "refresh_cache-ff0bb392-a296-45a0-a102-f8b0e1c9d41a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Instance network_info: |[{"id": "ffd805b9-7af4-452a-96ba-8abd05010a47", "address": "fa:16:3e:22:c2:66", "network": {"id": "7d870511-075a-4fa7-83ef-9147e626f8f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1824197985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603f18c021ae49fab9aaaa4b5f1fa780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd805b9-7a", "ovs_interfaceid": "ffd805b9-7af4-452a-96ba-8abd05010a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-daae61a1-58af-4d37-bdcb-0204bd76ad61 req-b4db9189-8353-4a21-8fb4-cb9da8088a47 service nova] Acquired lock "refresh_cache-ff0bb392-a296-45a0-a102-f8b0e1c9d41a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.network.neutron [req-daae61a1-58af-4d37-bdcb-0204bd76ad61 req-b4db9189-8353-4a21-8fb4-cb9da8088a47 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Refreshing network info cache for port ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Start _get_guest_xml network_info=[{"id": "ffd805b9-7af4-452a-96ba-8abd05010a47", "address": "fa:16:3e:22:c2:66", "network": {"id": "7d870511-075a-4fa7-83ef-9147e626f8f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1824197985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603f18c021ae49fab9aaaa4b5f1fa780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd805b9-7a", "ovs_interfaceid": "ffd805b9-7af4-452a-96ba-8abd05010a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:55:00 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:55:00 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:55:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-892164296',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-892164296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8921642',id=12,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUpY9OvtJb5gXTbB2ObE/iUFJ5fZIE6N1tqnldWOuY/UbNNJ6vWAen9O65+2TwhcbPVtG/xMR6HB7astU8BqHLmT//oydYQSahs+IIMrmyyMraXx8NcQGgQAQobcVw6NQ==',key_name='tempest-keypair-1872331603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='603f18c021ae49fab9aaaa4b5f1fa780',ramdisk_id='',reservation_id='r-5wtie27j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1390540328',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c802a14cf1642aaa356c481fe000696',uuid=ff0bb392-a296-45a0-a102-f8b0e1c9d41a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffd805b9-7af4-452a-96ba-8abd05010a47", "address": "fa:16:3e:22:c2:66", "network": {"id": "7d870511-075a-4fa7-83ef-9147e626f8f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1824197985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603f18c021ae49fab9aaaa4b5f1fa780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd805b9-7a", "ovs_interfaceid": "ffd805b9-7af4-452a-96ba-8abd05010a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Converting VIF {"id": "ffd805b9-7af4-452a-96ba-8abd05010a47", "address": "fa:16:3e:22:c2:66", "network": {"id": "7d870511-075a-4fa7-83ef-9147e626f8f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1824197985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603f18c021ae49fab9aaaa4b5f1fa780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd805b9-7a", "ovs_interfaceid": "ffd805b9-7af4-452a-96ba-8abd05010a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:c2:66,bridge_name='br-int',has_traffic_filtering=True,id=ffd805b9-7af4-452a-96ba-8abd05010a47,network=Network(7d870511-075a-4fa7-83ef-9147e626f8f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd805b9-7a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.objects.instance [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lazy-loading 'pci_devices' on Instance uuid ff0bb392-a296-45a0-a102-f8b0e1c9d41a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:55:01 user nova-compute[70645]:   <uuid>ff0bb392-a296-45a0-a102-f8b0e1c9d41a</uuid>
Jul 24 14:55:01 user nova-compute[70645]:   <name>instance-0000000c</name>
Jul 24 14:55:01 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:55:01 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:55:01 user nova-compute[70645]:   <metadata>
Jul 24 14:55:01 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:55:01 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:55:01 user nova-compute[70645]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-892164296</nova:name>
Jul 24 14:55:01 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:55:00</nova:creationTime>
Jul 24 14:55:01 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:55:01 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:55:01 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:55:01 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:55:01 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:55:01 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:55:01 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:55:01 user nova-compute[70645]:       <nova:owner>
Jul 24 14:55:01 user nova-compute[70645]:         <nova:user uuid="1c802a14cf1642aaa356c481fe000696">tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member</nova:user>
Jul 24 14:55:01 user nova-compute[70645]:         <nova:project uuid="603f18c021ae49fab9aaaa4b5f1fa780">tempest-TestServerVolumeAttachScenarioOldVersion-1390540328</nova:project>
Jul 24 14:55:01 user nova-compute[70645]:       </nova:owner>
Jul 24 14:55:01 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:55:01 user nova-compute[70645]:       <nova:ports>
Jul 24 14:55:01 user nova-compute[70645]:         <nova:port uuid="ffd805b9-7af4-452a-96ba-8abd05010a47">
Jul 24 14:55:01 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 14:55:01 user nova-compute[70645]:         </nova:port>
Jul 24 14:55:01 user nova-compute[70645]:       </nova:ports>
Jul 24 14:55:01 user nova-compute[70645]:     </nova:instance>
Jul 24 14:55:01 user nova-compute[70645]:   </metadata>
Jul 24 14:55:01 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:55:01 user nova-compute[70645]:     <system>
Jul 24 14:55:01 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:55:01 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:55:01 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:55:01 user nova-compute[70645]:       <entry name="serial">ff0bb392-a296-45a0-a102-f8b0e1c9d41a</entry>
Jul 24 14:55:01 user nova-compute[70645]:       <entry name="uuid">ff0bb392-a296-45a0-a102-f8b0e1c9d41a</entry>
Jul 24 14:55:01 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:55:01 user nova-compute[70645]:     </system>
Jul 24 14:55:01 user nova-compute[70645]:   </sysinfo>
Jul 24 14:55:01 user nova-compute[70645]:   <os>
Jul 24 14:55:01 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:55:01 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:55:01 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:55:01 user nova-compute[70645]:   </os>
Jul 24 14:55:01 user nova-compute[70645]:   <features>
Jul 24 14:55:01 user nova-compute[70645]:     <acpi/>
Jul 24 14:55:01 user nova-compute[70645]:     <apic/>
Jul 24 14:55:01 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:55:01 user nova-compute[70645]:   </features>
Jul 24 14:55:01 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:55:01 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:55:01 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:55:01 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:55:01 user nova-compute[70645]:   </clock>
Jul 24 14:55:01 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:55:01 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:55:01 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:55:01 user nova-compute[70645]:   </cpu>
Jul 24 14:55:01 user nova-compute[70645]:   <devices>
Jul 24 14:55:01 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:55:01 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:55:01 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk"/>
Jul 24 14:55:01 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:55:01 user nova-compute[70645]:     </disk>
Jul 24 14:55:01 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:55:01 user nova-compute[70645]:       <mac address="fa:16:3e:22:c2:66"/>
Jul 24 14:55:01 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:55:01 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:55:01 user nova-compute[70645]:       <target dev="tapffd805b9-7a"/>
Jul 24 14:55:01 user nova-compute[70645]:     </interface>
Jul 24 14:55:01 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:55:01 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/console.log" append="off"/>
Jul 24 14:55:01 user nova-compute[70645]:     </serial>
Jul 24 14:55:01 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:55:01 user nova-compute[70645]:     <video>
Jul 24 14:55:01 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:55:01 user nova-compute[70645]:     </video>
Jul 24 14:55:01 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:55:01 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:55:01 user nova-compute[70645]:     </rng>
Jul 24 14:55:01 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:55:01 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:55:01 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:55:01 user nova-compute[70645]:     </memballoon>
Jul 24 14:55:01 user nova-compute[70645]:   </devices>
Jul 24 14:55:01 user nova-compute[70645]: </domain>
Jul 24 14:55:01 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-892164296',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-892164296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8921642',id=12,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUpY9OvtJb5gXTbB2ObE/iUFJ5fZIE6N1tqnldWOuY/UbNNJ6vWAen9O65+2TwhcbPVtG/xMR6HB7astU8BqHLmT//oydYQSahs+IIMrmyyMraXx8NcQGgQAQobcVw6NQ==',key_name='tempest-keypair-1872331603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='603f18c021ae49fab9aaaa4b5f1fa780',ramdisk_id='',reservation_id='r-5wtie27j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1390540328',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c802a14cf1642aaa356c481fe000696',uuid=ff0bb392-a296-45a0-a102-f8b0e1c9d41a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffd805b9-7af4-452a-96ba-8abd05010a47", "address": "fa:16:3e:22:c2:66", "network": {"id": "7d870511-075a-4fa7-83ef-9147e626f8f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1824197985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603f18c021ae49fab9aaaa4b5f1fa780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd805b9-7a", "ovs_interfaceid": "ffd805b9-7af4-452a-96ba-8abd05010a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Converting VIF {"id": "ffd805b9-7af4-452a-96ba-8abd05010a47", "address": "fa:16:3e:22:c2:66", "network": {"id": "7d870511-075a-4fa7-83ef-9147e626f8f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1824197985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603f18c021ae49fab9aaaa4b5f1fa780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd805b9-7a", "ovs_interfaceid": "ffd805b9-7af4-452a-96ba-8abd05010a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:c2:66,bridge_name='br-int',has_traffic_filtering=True,id=ffd805b9-7af4-452a-96ba-8abd05010a47,network=Network(7d870511-075a-4fa7-83ef-9147e626f8f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd805b9-7a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_vif [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:c2:66,bridge_name='br-int',has_traffic_filtering=True,id=ffd805b9-7af4-452a-96ba-8abd05010a47,network=Network(7d870511-075a-4fa7-83ef-9147e626f8f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd805b9-7a') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffd805b9-7a, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapffd805b9-7a, col_values=(('external_ids', {'iface-id': 'ffd805b9-7af4-452a-96ba-8abd05010a47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:c2:66', 'vm-uuid': 'ff0bb392-a296-45a0-a102-f8b0e1c9d41a'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:01 user nova-compute[70645]: INFO os_vif [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:c2:66,bridge_name='br-int',has_traffic_filtering=True,id=ffd805b9-7af4-452a-96ba-8abd05010a47,network=Network(7d870511-075a-4fa7-83ef-9147e626f8f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd805b9-7a')
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] No VIF found with MAC fa:16:3e:22:c2:66, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.network.neutron [req-daae61a1-58af-4d37-bdcb-0204bd76ad61 req-b4db9189-8353-4a21-8fb4-cb9da8088a47 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Updated VIF entry in instance network info cache for port ffd805b9-7af4-452a-96ba-8abd05010a47. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.network.neutron [req-daae61a1-58af-4d37-bdcb-0204bd76ad61 req-b4db9189-8353-4a21-8fb4-cb9da8088a47 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Updating instance_info_cache with network_info: [{"id": "ffd805b9-7af4-452a-96ba-8abd05010a47", "address": "fa:16:3e:22:c2:66", "network": {"id": "7d870511-075a-4fa7-83ef-9147e626f8f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1824197985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603f18c021ae49fab9aaaa4b5f1fa780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd805b9-7a", "ovs_interfaceid": "ffd805b9-7af4-452a-96ba-8abd05010a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '26537623865373464', 'path': '/dev/sdj'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537623865373464', 'path': '/dev/sdj'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-daae61a1-58af-4d37-bdcb-0204bd76ad61 req-b4db9189-8353-4a21-8fb4-cb9da8088a47 service nova] Releasing lock "refresh_cache-ff0bb392-a296-45a0-a102-f8b0e1c9d41a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.objects.instance [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lazy-loading 'flavor' on Instance uuid ea55b3b9-4821-4400-b99f-ba233c2a7395 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 14:55:01 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:01 user nova-compute[70645]:   <source dev="/dev/sdj"/>
Jul 24 14:55:01 user nova-compute[70645]:   <target dev="sdc" bus="scsi"/>
Jul 24 14:55:01 user nova-compute[70645]:   <serial>6723f311-e54a-4cc9-afc3-3f222a86af55</serial>
Jul 24 14:55:01 user nova-compute[70645]:   <address type="drive" controller="0" unit="2"/>
Jul 24 14:55:01 user nova-compute[70645]: </disk>
Jul 24 14:55:01 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEfAbcXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:01 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:01 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:01 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a15bcef-d7f2-46b9-a1c6-8fc86f8b65ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:55:01 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58dfb73-a6f9-4ce4-8543-44b1ead90604]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d] added
Jul 24 14:55:01 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e74b457-7c51-4c3b-a100-eb98fc5e7488]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[115eb4d3-8989-4ab4-b805-e278ede523b2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEfAbcXZ {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEfAbcXZ" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89ddebc-6dee-4f87-8314-2365af3d0e4c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VEfAbcXZ'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bed883-931f-4a6f-8e32-af207c5a5637]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d93739-8c21-4456-a552-1668a4309701]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:01 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:01 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:01 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6344a0d-c8c8-4f36-85b6-96a78a50218f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260]
Jul 24 14:55:02 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:02 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9360c91-24a3-4075-9385-a21f169f3700]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d8d3a9-756c-4cdd-bdff-e6c7aab0abe9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:02 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:02 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:02 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec31ac46-558f-4ec9-bc5c-fa6478bb7ee2]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEfAbcXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "f1a667e2-7992-44e4-9500-fa598493e173" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:02 user nova-compute[70645]: INFO nova.compute.manager [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Detaching volume 0fb4f199-da3f-4814-8d6e-a53bf0ed284f
Jul 24 14:55:02 user nova-compute[70645]: INFO nova.virt.block_device [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Attempting to driver detach volume 0fb4f199-da3f-4814-8d6e-a53bf0ed284f from mountpoint /dev/vdb
Jul 24 14:55:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Attempting to detach device vdb from instance f1a667e2-7992-44e4-9500-fa598493e173 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 14:55:02 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:02 user nova-compute[70645]:   <source dev="/dev/sdi"/>
Jul 24 14:55:02 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:55:02 user nova-compute[70645]:   <serial>0fb4f199-da3f-4814-8d6e-a53bf0ed284f</serial>
Jul 24 14:55:02 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 14:55:02 user nova-compute[70645]: </disk>
Jul 24 14:55:02 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:55:02 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Successfully detached device vdb from instance f1a667e2-7992-44e4-9500-fa598493e173 from the persistent domain config.
Jul 24 14:55:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1a667e2-7992-44e4-9500-fa598493e173 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 14:55:02 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:02 user nova-compute[70645]:   <source dev="/dev/sdi"/>
Jul 24 14:55:02 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:55:02 user nova-compute[70645]:   <serial>0fb4f199-da3f-4814-8d6e-a53bf0ed284f</serial>
Jul 24 14:55:02 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 14:55:02 user nova-compute[70645]: </disk>
Jul 24 14:55:02 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Acquiring lock "07268543-d6a3-479b-a4b9-e0cc87bb068a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Acquiring lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:02 user nova-compute[70645]: INFO nova.compute.manager [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Terminating instance
Jul 24 14:55:02 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] No BDM found with device name sda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] No BDM found with device name sdc, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] No VIF found with MAC fa:16:3e:ef:95:ba, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690210503.118812, f1a667e2-7992-44e4-9500-fa598493e173 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-6422fad5-ea96-45a4-b6af-1b581d225044 req-e6e0ad40-2a2a-48b6-a303-4a5e00d6b2c2 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-vif-unplugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6422fad5-ea96-45a4-b6af-1b581d225044 req-e6e0ad40-2a2a-48b6-a303-4a5e00d6b2c2 service nova] Acquiring lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6422fad5-ea96-45a4-b6af-1b581d225044 req-e6e0ad40-2a2a-48b6-a303-4a5e00d6b2c2 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6422fad5-ea96-45a4-b6af-1b581d225044 req-e6e0ad40-2a2a-48b6-a303-4a5e00d6b2c2 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-6422fad5-ea96-45a4-b6af-1b581d225044 req-e6e0ad40-2a2a-48b6-a303-4a5e00d6b2c2 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] No waiting events found dispatching network-vif-unplugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-6422fad5-ea96-45a4-b6af-1b581d225044 req-e6e0ad40-2a2a-48b6-a303-4a5e00d6b2c2 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-vif-unplugged-a650a482-e323-4826-93ef-c9cdece514b2 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1a667e2-7992-44e4-9500-fa598493e173 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 14:55:03 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Successfully detached device vdb from instance f1a667e2-7992-44e4-9500-fa598493e173 from the live domain config.
Jul 24 14:55:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dltgeNKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:03 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fec1809c-855f-489b-9bc1-003e1367e342 tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.506s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '23931383730343038', 'path': '/dev/sdk'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931383730343038', 'path': '/dev/sdk'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.033s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG nova.objects.instance [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lazy-loading 'flavor' on Instance uuid a816f335-7f2e-4121-9667-237b22349724 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eba754e-40bf-4fda-8063-e68f20ff86d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 14:55:03 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:03 user nova-compute[70645]:   <source dev="/dev/sdk"/>
Jul 24 14:55:03 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:55:03 user nova-compute[70645]:   <serial>317500b2-0855-4b5d-8697-2df652366e5d</serial>
Jul 24 14:55:03 user nova-compute[70645]: </disk>
Jul 24 14:55:03 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fd19a3-21ae-4fbe-9fc0-50d5dbac65ab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:03 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:03 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:03 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba846489d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f'): ({'sdi'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Removing single pathed devices sdi {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6abdf3-d832-4a56-baac-b8c42bb749e8]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b47327-8f35-4d64-b644-f4ea8fb60f83]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Flushing IO for device /dev/sdi {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff62676-1215-4a74-acbe-5b142d17ff2e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.109s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[19392a89-fd47-4a49-90c8-b9588dc691a5]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] SCSI volumes sdi have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dbb9f0-e6de-44ea-accb-7aa869d5431c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0407725-4e37-48f5-8e9e-e5431867cfbb]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f, portal: 172.16.0.220,3260]
Jul 24 14:55:03 user nova-compute[70645]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:03 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb4f199-da3f-4814-8d6e-a53bf0ed284f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.075s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d0b160-594c-404b-9bf4-9a15b9678553]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.569s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] <== disconnect_volume: return (602ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:03 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Instance destroyed successfully.
Jul 24 14:55:03 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lazy-loading 'resources' on Instance uuid 07268543-d6a3-479b-a4b9-e0cc87bb068a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-119760614',display_name='tempest-VolumesActionsTest-instance-119760614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-119760614',id=5,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446386c2f44f4b1e9a8c072d79ba64ce',ramdisk_id='',reservation_id='r-6v0nwsg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-707520480',owner_user_name='tempest-VolumesActionsTest-707520480-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:53:07Z,user_data=None,user_id='081e1e09648c44789781713d80e8749c',uuid=07268543-d6a3-479b-a4b9-e0cc87bb068a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a650a482-e323-4826-93ef-c9cdece514b2", "address": "fa:16:3e:fc:7e:d1", "network": {"id": "4e47d6a0-7724-4c9e-8841-bf267c069126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039189837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446386c2f44f4b1e9a8c072d79ba64ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa650a482-e3", "ovs_interfaceid": "a650a482-e323-4826-93ef-c9cdece514b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Converting VIF {"id": "a650a482-e323-4826-93ef-c9cdece514b2", "address": "fa:16:3e:fc:7e:d1", "network": {"id": "4e47d6a0-7724-4c9e-8841-bf267c069126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039189837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446386c2f44f4b1e9a8c072d79ba64ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa650a482-e3", "ovs_interfaceid": "a650a482-e323-4826-93ef-c9cdece514b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7e:d1,bridge_name='br-int',has_traffic_filtering=True,id=a650a482-e323-4826-93ef-c9cdece514b2,network=Network(4e47d6a0-7724-4c9e-8841-bf267c069126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa650a482-e3') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG os_vif [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7e:d1,bridge_name='br-int',has_traffic_filtering=True,id=a650a482-e323-4826-93ef-c9cdece514b2,network=Network(4e47d6a0-7724-4c9e-8841-bf267c069126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa650a482-e3') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa650a482-e3, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:04 user nova-compute[70645]: INFO os_vif [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7e:d1,bridge_name='br-int',has_traffic_filtering=True,id=a650a482-e323-4826-93ef-c9cdece514b2,network=Network(4e47d6a0-7724-4c9e-8841-bf267c069126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa650a482-e3')
Jul 24 14:55:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Deleting instance files /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a_del
Jul 24 14:55:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Deletion of /opt/stack/data/nova/instances/07268543-d6a3-479b-a4b9-e0cc87bb068a_del complete
Jul 24 14:55:04 user nova-compute[70645]: INFO nova.compute.manager [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Took 1.67 seconds to destroy the instance on the hypervisor.
Jul 24 14:55:04 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:04 user nova-compute[70645]: INFO nova.compute.manager [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Detaching volume 6723f311-e54a-4cc9-afc3-3f222a86af55
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-c41f98dc-0344-47e9-9ccf-0b812b401063 req-73bcbb91-1834-4636-a6de-8e27e5873428 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Received event network-vif-plugged-ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c41f98dc-0344-47e9-9ccf-0b812b401063 req-73bcbb91-1834-4636-a6de-8e27e5873428 service nova] Acquiring lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c41f98dc-0344-47e9-9ccf-0b812b401063 req-73bcbb91-1834-4636-a6de-8e27e5873428 service nova] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c41f98dc-0344-47e9-9ccf-0b812b401063 req-73bcbb91-1834-4636-a6de-8e27e5873428 service nova] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-c41f98dc-0344-47e9-9ccf-0b812b401063 req-73bcbb91-1834-4636-a6de-8e27e5873428 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] No waiting events found dispatching network-vif-plugged-ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:04 user nova-compute[70645]: WARNING nova.compute.manager [req-c41f98dc-0344-47e9-9ccf-0b812b401063 req-73bcbb91-1834-4636-a6de-8e27e5873428 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Received unexpected event network-vif-plugged-ffd805b9-7af4-452a-96ba-8abd05010a47 for instance with vm_state building and task_state spawning.
Jul 24 14:55:04 user nova-compute[70645]: INFO nova.virt.block_device [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Attempting to driver detach volume 6723f311-e54a-4cc9-afc3-3f222a86af55 from mountpoint /dev/sdc
Jul 24 14:55:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Attempting to detach device sdc from instance ea55b3b9-4821-4400-b99f-ba233c2a7395 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 14:55:04 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:04 user nova-compute[70645]:   <source dev="/dev/sdj"/>
Jul 24 14:55:04 user nova-compute[70645]:   <target dev="sdc" bus="scsi"/>
Jul 24 14:55:04 user nova-compute[70645]:   <serial>6723f311-e54a-4cc9-afc3-3f222a86af55</serial>
Jul 24 14:55:04 user nova-compute[70645]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 24 14:55:04 user nova-compute[70645]: </disk>
Jul 24 14:55:04 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:55:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Successfully detached device sdc from instance ea55b3b9-4821-4400-b99f-ba233c2a7395 from the persistent domain config.
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ea55b3b9-4821-4400-b99f-ba233c2a7395 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 14:55:04 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:04 user nova-compute[70645]:   <source dev="/dev/sdj"/>
Jul 24 14:55:04 user nova-compute[70645]:   <target dev="sdc" bus="scsi"/>
Jul 24 14:55:04 user nova-compute[70645]:   <serial>6723f311-e54a-4cc9-afc3-3f222a86af55</serial>
Jul 24 14:55:04 user nova-compute[70645]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 24 14:55:04 user nova-compute[70645]: </disk>
Jul 24 14:55:04 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] No VIF found with MAC fa:16:3e:6a:c6:57, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-055b7b7e-096a-4ec5-8f38-deff84f7c6ef tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.854s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lazy-loading 'flavor' on Instance uuid f1a667e2-7992-44e4-9500-fa598493e173 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-bcc8d5e9-1719-4eb1-9e00-dc2c2b56b0ef tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.634s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690210505.128081, ea55b3b9-4821-4400-b99f-ba233c2a7395 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ea55b3b9-4821-4400-b99f-ba233c2a7395 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 14:55:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Successfully detached device sdc from instance ea55b3b9-4821-4400-b99f-ba233c2a7395 from the live domain config.
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmETPLiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:05 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc270106-6d89-477c-8f32-5dcdbef48ee0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Acquiring lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] No waiting events found dispatching network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:05 user nova-compute[70645]: WARNING nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received unexpected event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 for instance with vm_state active and task_state deleting.
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Acquiring lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] No waiting events found dispatching network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:05 user nova-compute[70645]: WARNING nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received unexpected event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 for instance with vm_state active and task_state deleting.
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Acquiring lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] No waiting events found dispatching network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:05 user nova-compute[70645]: WARNING nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received unexpected event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 for instance with vm_state active and task_state deleting.
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-vif-unplugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Acquiring lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] No waiting events found dispatching network-vif-unplugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-vif-unplugged-a650a482-e323-4826-93ef-c9cdece514b2 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Acquiring lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] No waiting events found dispatching network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:05 user nova-compute[70645]: WARNING nova.compute.manager [req-145f67b2-f880-4440-8c3c-973ffff3cc5a req-2e034141-2872-4023-9610-02c8617ef813 service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received unexpected event network-vif-plugged-a650a482-e323-4826-93ef-c9cdece514b2 for instance with vm_state active and task_state deleting.
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[887a9656-5875-4fe9-be0f-e305fb2df3c4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:05 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba8464b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55'): ({'sdj'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Removing single pathed devices sdj {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[58362a61-e694-45e5-993c-a05cf4998482]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12da6d4-6e09-4d4a-812d-ece6fe0ec923]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-acfaea75-1e80-4a92-9737-77a1e67d96a4 req-1887e091-52db-466c-bb4d-7e83ef52019a service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Received event network-vif-deleted-a650a482-e323-4826-93ef-c9cdece514b2 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:05 user nova-compute[70645]: INFO nova.compute.manager [req-acfaea75-1e80-4a92-9737-77a1e67d96a4 req-1887e091-52db-466c-bb4d-7e83ef52019a service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Neutron deleted interface a650a482-e323-4826-93ef-c9cdece514b2; detaching it from the instance and deleting it from the info cache
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.network.neutron [req-acfaea75-1e80-4a92-9737-77a1e67d96a4 req-1887e091-52db-466c-bb4d-7e83ef52019a service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Flushing IO for device /dev/sdj {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:55:05 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Took 1.04 seconds to deallocate network for instance.
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0590d0-44ef-419b-80d1-0b7b902e7a9f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-acfaea75-1e80-4a92-9737-77a1e67d96a4 req-1887e091-52db-466c-bb4d-7e83ef52019a service nova] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Detach interface failed, port_id=a650a482-e323-4826-93ef-c9cdece514b2, reason: Instance 07268543-d6a3-479b-a4b9-e0cc87bb068a could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.046s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f71fcf4-e80b-4ea5-b69a-81b493809972]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] SCSI volumes sdj have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e890fb-4283-4149-96f9-2f11e9504278]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63665e4-2ae5-4767-a5ef-b800579729a4]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55, portal: 172.16.0.220,3260]
Jul 24 14:55:05 user nova-compute[70645]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723f311-e54a-4cc9-afc3-3f222a86af55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[98833e5d-0c09-4a30-81bf-e4b89ff12721]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] <== disconnect_volume: return (392ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:55:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:05 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Deleted allocations for instance 07268543-d6a3-479b-a4b9-e0cc87bb068a
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2103131d-f3ac-4834-bded-a33d8b914633 tempest-VolumesActionsTest-707520480 tempest-VolumesActionsTest-707520480-project-member] Lock "07268543-d6a3-479b-a4b9-e0cc87bb068a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.447s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "a816f335-7f2e-4121-9667-237b22349724" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG os_brick.utils [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5c4740-8bc9-4627-9ac3-2a95013593ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[370efde4-f4e5-4e51-95e4-baf1296ec614]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dd7e0d-cfa2-440b-875d-b2b03969e95f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[189bfd8b-e071-4418-a977-65610dbf02a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:55:06 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b6337a-55a3-440f-a097-b9733b863379]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG os_brick.utils [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-6b688e0c-dd01-447a-b539-c2a8275992c5 req-b677abdb-3db9-4972-8af1-2a9aca2aabf5 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Received event network-vif-plugged-ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6b688e0c-dd01-447a-b539-c2a8275992c5 req-b677abdb-3db9-4972-8af1-2a9aca2aabf5 service nova] Acquiring lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6b688e0c-dd01-447a-b539-c2a8275992c5 req-b677abdb-3db9-4972-8af1-2a9aca2aabf5 service nova] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6b688e0c-dd01-447a-b539-c2a8275992c5 req-b677abdb-3db9-4972-8af1-2a9aca2aabf5 service nova] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-6b688e0c-dd01-447a-b539-c2a8275992c5 req-b677abdb-3db9-4972-8af1-2a9aca2aabf5 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] No waiting events found dispatching network-vif-plugged-ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:06 user nova-compute[70645]: WARNING nova.compute.manager [req-6b688e0c-dd01-447a-b539-c2a8275992c5 req-b677abdb-3db9-4972-8af1-2a9aca2aabf5 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Received unexpected event network-vif-plugged-ffd805b9-7af4-452a-96ba-8abd05010a47 for instance with vm_state building and task_state spawning.
Jul 24 14:55:06 user nova-compute[70645]: DEBUG nova.objects.instance [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lazy-loading 'flavor' on Instance uuid ea55b3b9-4821-4400-b99f-ba233c2a7395 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e57c5e2c-b59f-4384-abf2-3afd8f7bfdef tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.267s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:06 user nova-compute[70645]: INFO nova.compute.manager [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] Swapping volume 317500b2-0855-4b5d-8697-2df652366e5d for 56427b94-10c4-4a08-bc13-0d2a081390c8
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:06 user nova-compute[70645]: INFO nova.compute.manager [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Terminating instance
Jul 24 14:55:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210507.1132386, ff0bb392-a296-45a0-a102-f8b0e1c9d41a => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:55:07 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] VM Resumed (Lifecycle Event)
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:55:07 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Instance spawned successfully.
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:07 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210507.1134136, ff0bb392-a296-45a0-a102-f8b0e1c9d41a => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:55:07 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] VM Started (Lifecycle Event)
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:55:07 user nova-compute[70645]: INFO nova.compute.manager [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Took 8.49 seconds to spawn the instance on the hypervisor.
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:07 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-3016d388-19a0-4bd1-b710-9b38c7f08530 req-a27ed7df-e300-4ddc-afbf-c8b170c78650 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Received event network-vif-unplugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3016d388-19a0-4bd1-b710-9b38c7f08530 req-a27ed7df-e300-4ddc-afbf-c8b170c78650 service nova] Acquiring lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3016d388-19a0-4bd1-b710-9b38c7f08530 req-a27ed7df-e300-4ddc-afbf-c8b170c78650 service nova] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3016d388-19a0-4bd1-b710-9b38c7f08530 req-a27ed7df-e300-4ddc-afbf-c8b170c78650 service nova] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-3016d388-19a0-4bd1-b710-9b38c7f08530 req-a27ed7df-e300-4ddc-afbf-c8b170c78650 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] No waiting events found dispatching network-vif-unplugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-3016d388-19a0-4bd1-b710-9b38c7f08530 req-a27ed7df-e300-4ddc-afbf-c8b170c78650 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Received event network-vif-unplugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:55:07 user nova-compute[70645]: INFO nova.compute.manager [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Took 9.71 seconds to build instance.
Jul 24 14:55:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1afabe62-092a-4f14-8b9f-60e5a5b99efc tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.887s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:07 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Instance destroyed successfully.
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lazy-loading 'resources' on Instance uuid ea55b3b9-4821-4400-b99f-ba233c2a7395 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-974676531',display_name='tempest-AttachSCSIVolumeTestJSON-server-974676531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-974676531',id=6,image_ref='dcd48dec-7021-4cfa-bd29-b9c55c2f2cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInRA30WQI2ncmFKQn/oAodzJ60cf3EdPzqx8kJsNZ2szWIrc8JJvcbJLVrZu2ZVnzcUJ+CCma2USfgU8/ECWbQFqS2TqQTaQ85Qpx8I8KHw5+XXPjQUwJ1GSOYLFbNqGg==',key_name='tempest-keypair-205192162',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f383c938a0a44aa994cf1d464f94e34d',ramdisk_id='',reservation_id='r-kmb4dy7e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dcd48dec-7021-4cfa-bd29-b9c55c2f2cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-933288876',owner_user_name='tempest-AttachSCSIVolumeTestJSON-933288876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:53:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88449d0e7b294376884edb24722bbd39',uuid=ea55b3b9-4821-4400-b99f-ba233c2a7395,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "address": "fa:16:3e:ef:95:ba", "network": {"id": "8fb8583c-cd2f-4a58-96b5-8fe7c93535a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-455369873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f383c938a0a44aa994cf1d464f94e34d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24dcb843-59", "ovs_interfaceid": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Converting VIF {"id": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "address": "fa:16:3e:ef:95:ba", "network": {"id": "8fb8583c-cd2f-4a58-96b5-8fe7c93535a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-455369873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f383c938a0a44aa994cf1d464f94e34d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24dcb843-59", "ovs_interfaceid": "24dcb843-5910-4f0c-bace-e9b24f5536a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:95:ba,bridge_name='br-int',has_traffic_filtering=True,id=24dcb843-5910-4f0c-bace-e9b24f5536a8,network=Network(8fb8583c-cd2f-4a58-96b5-8fe7c93535a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24dcb843-59') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG os_vif [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:95:ba,bridge_name='br-int',has_traffic_filtering=True,id=24dcb843-5910-4f0c-bace-e9b24f5536a8,network=Network(8fb8583c-cd2f-4a58-96b5-8fe7c93535a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24dcb843-59') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24dcb843-59, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:07 user nova-compute[70645]: INFO os_vif [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:95:ba,bridge_name='br-int',has_traffic_filtering=True,id=24dcb843-5910-4f0c-bace-e9b24f5536a8,network=Network(8fb8583c-cd2f-4a58-96b5-8fe7c93535a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24dcb843-59')
Jul 24 14:55:07 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Deleting instance files /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395_del
Jul 24 14:55:07 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Deletion of /opt/stack/data/nova/instances/ea55b3b9-4821-4400-b99f-ba233c2a7395_del complete
Jul 24 14:55:07 user nova-compute[70645]: INFO nova.compute.manager [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 24 14:55:07 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:55:07 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYUwlNGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:08 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:08 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:08 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f146cdd-5dd6-41aa-a7e0-6a7e8b9e16da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:55:08 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6d167e-b4e1-4412-b1da-5bc71df802ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b] added
Jul 24 14:55:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[92623122-0ff5-4faa-9275-25a195348fc1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[750a22e0-39e9-47d6-98e5-75b07da0691f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYUwlNGF {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYUwlNGF" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea55bef-e594-4385-bf57-1560f2b08df0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QYUwlNGF'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[16679271-d7fd-4684-8dfe-c3435b239c15]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.073s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b257afb0-105e-4eae-9fc8-712130be22f1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --login" returned: 0 in 0.246s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f384f59-3c9d-4941-96e4-11ecf4314b6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b, portal: 172.16.0.220,3260]
Jul 24 14:55:08 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd2944-1851-4b16-b8be-03b2d8a61ecb]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32bbe17-aa07-47e8-bfe3-84e20eb16a13]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:08 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.559s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02d7ef7-6f1d-4aa1-90a7-1df2c0918ce1]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:55:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYUwlNGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:55:09 user nova-compute[70645]: DEBUG nova.compute.manager [req-2a33c84a-8861-45d4-8a36-435948fcad54 req-623c7a76-8a9b-4a5a-a067-054aade54283 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Received event network-vif-plugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2a33c84a-8861-45d4-8a36-435948fcad54 req-623c7a76-8a9b-4a5a-a067-054aade54283 service nova] Acquiring lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2a33c84a-8861-45d4-8a36-435948fcad54 req-623c7a76-8a9b-4a5a-a067-054aade54283 service nova] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2a33c84a-8861-45d4-8a36-435948fcad54 req-623c7a76-8a9b-4a5a-a067-054aade54283 service nova] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:09 user nova-compute[70645]: DEBUG nova.compute.manager [req-2a33c84a-8861-45d4-8a36-435948fcad54 req-623c7a76-8a9b-4a5a-a067-054aade54283 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] No waiting events found dispatching network-vif-plugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:09 user nova-compute[70645]: WARNING nova.compute.manager [req-2a33c84a-8861-45d4-8a36-435948fcad54 req-623c7a76-8a9b-4a5a-a067-054aade54283 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Received unexpected event network-vif-plugged-24dcb843-5910-4f0c-bace-e9b24f5536a8 for instance with vm_state active and task_state deleting.
Jul 24 14:55:09 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:09 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Took 1.74 seconds to deallocate network for instance.
Jul 24 14:55:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.609s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] <== connect_volume: return (1610ms) {'type': 'block', 'scsi_wwn': '23730363936346563', 'path': '/dev/sdi'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730363936346563', 'path': '/dev/sdi'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:55:09 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lazy-loading 'flavor' on Instance uuid 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 14:55:09 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:09 user nova-compute[70645]:   <source dev="/dev/sdi"/>
Jul 24 14:55:09 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:55:09 user nova-compute[70645]:   <serial>79e20d09-7ee7-4d94-bc9c-48c2ac86c72b</serial>
Jul 24 14:55:09 user nova-compute[70645]: </disk>
Jul 24 14:55:09 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 14:55:10 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:55:10 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:55:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:10 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Deleted allocations for instance ea55b3b9-4821-4400-b99f-ba233c2a7395
Jul 24 14:55:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] No BDM found with device name hda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] No VIF found with MAC fa:16:3e:32:d0:25, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:55:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c217c819-5026-491c-847a-058c662e5a0f tempest-AttachSCSIVolumeTestJSON-933288876 tempest-AttachSCSIVolumeTestJSON-933288876-project-member] Lock "ea55b3b9-4821-4400-b99f-ba233c2a7395" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.322s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7dbf3ccc-b74a-434b-b92c-557d8efdc6ae tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:11 user nova-compute[70645]: DEBUG nova.compute.manager [req-d622c27b-0e6d-4805-a075-eafacf346cbd req-5aa9b1e0-35c2-48b0-bead-4ee280bbe6a9 service nova] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Received event network-vif-deleted-24dcb843-5910-4f0c-bace-e9b24f5536a8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:11 user nova-compute[70645]: INFO nova.compute.manager [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Detaching volume 79e20d09-7ee7-4d94-bc9c-48c2ac86c72b
Jul 24 14:55:12 user nova-compute[70645]: INFO nova.virt.block_device [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Attempting to driver detach volume 79e20d09-7ee7-4d94-bc9c-48c2ac86c72b from mountpoint /dev/vdb
Jul 24 14:55:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Attempting to detach device vdb from instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 14:55:12 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:12 user nova-compute[70645]:   <source dev="/dev/sdi"/>
Jul 24 14:55:12 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:55:12 user nova-compute[70645]:   <serial>79e20d09-7ee7-4d94-bc9c-48c2ac86c72b</serial>
Jul 24 14:55:12 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 14:55:12 user nova-compute[70645]: </disk>
Jul 24 14:55:12 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:55:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Successfully detached device vdb from instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 from the persistent domain config.
Jul 24 14:55:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 14:55:12 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:12 user nova-compute[70645]:   <source dev="/dev/sdi"/>
Jul 24 14:55:12 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:55:12 user nova-compute[70645]:   <serial>79e20d09-7ee7-4d94-bc9c-48c2ac86c72b</serial>
Jul 24 14:55:12 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 14:55:12 user nova-compute[70645]: </disk>
Jul 24 14:55:12 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690210512.5299494, 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 14:55:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Successfully detached device vdb from instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 from the live domain config.
Jul 24 14:55:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYUwlNGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:12 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c58253-6276-48fa-8192-87b19930eebd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[565fa90c-e443-4ed7-99ea-3480e7956f91]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:12 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba846780d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b'): ({'sdi'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Removing single pathed devices sdi {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afb5b52-b30c-4835-88fe-111dd1d5e552]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ba4de-689f-45a1-9866-b692a8ee7ca3]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Flushing IO for device /dev/sdi {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f9bce1-2060-4e3d-aa80-fa20e875ea84]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e18ed4-24f8-4296-8514-4620df5a8e0a]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] SCSI volumes sdi have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ba728-6487-4feb-a769-1e3ebde7190f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5342fc74-11e8-44d8-98da-587f2d81305d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b, portal: 172.16.0.220,3260]
Jul 24 14:55:12 user nova-compute[70645]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e20d09-7ee7-4d94-bc9c-48c2ac86c72b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1246e224-dab6-4607-9064-0b25959c5ae1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] <== disconnect_volume: return (348ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:55:13 user nova-compute[70645]: DEBUG nova.objects.instance [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lazy-loading 'flavor' on Instance uuid 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6ecbdf21-808c-4bf2-a4bd-cc62fd7f9ad0 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.009s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDgUkXsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a816f335-7f2e-4121-9667-237b22349724', 'attached_at': '', 'detached_at': '', 'volume_id': '56427b94-10c4-4a08-bc13-0d2a081390c8', 'serial': '56427b94-10c4-4a08-bc13-0d2a081390c8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEfAbcXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'a816f335-7f2e-4121-9667-237b22349724', 'attached_at': '', 'detached_at': '', 'volume_id': '317500b2-0855-4b5d-8697-2df652366e5d', 'serial'} {{(pid=70645) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDgUkXsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:14 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:14 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:14 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "interface-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-d86fc3c3-4140-4680-b72b-439583652c7f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "interface-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-d86fc3c3-4140-4680-b72b-439583652c7f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b8f428-82d5-4c97-b8b2-624f6b405801]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:55:14 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.objects.instance [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lazy-loading 'flavor' on Instance uuid 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4be7ca-90b1-408e-820a-980589fb7330]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8] added
Jul 24 14:55:14 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-896493417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-896493417',id=8,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOC+pbtS3b10zgGPN8jzEAGTj3Lutj6NjqD/u3q2th61GdXcNYKMiu+ZkghxLk9jByTpKK5pKCNa5736mrWQiHDLOInWyMhYDKqT7SxK/aJuuMMC5WiwiwkOIdnj15Mqg==',key_name='tempest-keypair-1737242635',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7e96ad4dba143709ad8715dea63bf23',ramdisk_id='',reservation_id='r-wle60jho',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-813130247',owner_user_name='tempest-TaggedAttachmentsTest-813130247-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28e6065f28da456b888cc801f7561b85',uuid=5f355cfc-9d1b-4f2b-936b-e28a65bd99e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d86fc3c3-4140-4680-b72b-439583652c7f", "address": "fa:16:3e:61:23:bd", "network": {"id": "c7f79393-5e5e-48f8-999f-b74a41796eed", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1611956044", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86fc3c3-41", "ovs_interfaceid": "d86fc3c3-4140-4680-b72b-439583652c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converting VIF {"id": "d86fc3c3-4140-4680-b72b-439583652c7f", "address": "fa:16:3e:61:23:bd", "network": {"id": "c7f79393-5e5e-48f8-999f-b74a41796eed", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1611956044", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86fc3c3-41", "ovs_interfaceid": "d86fc3c3-4140-4680-b72b-439583652c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:23:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86fc3c3-4140-4680-b72b-439583652c7f,network=Network(c7f79393-5e5e-48f8-999f-b74a41796eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86fc3c3-41') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:61:23:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapd86fc3c3-41"/></interface> {{(pid=70645) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:61:23:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapd86fc3c3-41"/></interface> {{(pid=70645) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Attempting to detach device tapd86fc3c3-41 from instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] detach device xml: <interface type="ethernet">
Jul 24 14:55:14 user nova-compute[70645]:   <mac address="fa:16:3e:61:23:bd"/>
Jul 24 14:55:14 user nova-compute[70645]:   <model type="virtio"/>
Jul 24 14:55:14 user nova-compute[70645]:   <mtu size="1442"/>
Jul 24 14:55:14 user nova-compute[70645]:   <target dev="tapd86fc3c3-41"/>
Jul 24 14:55:14 user nova-compute[70645]: </interface>
Jul 24 14:55:14 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8356290a-ce4f-476c-97fa-2349874ef3e9]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:61:23:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapd86fc3c3-41"/></interface> {{(pid=70645) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:61:23:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapd86fc3c3-41"/></interface>not found in domain: <domain type='kvm' id='8'>
Jul 24 14:55:14 user nova-compute[70645]:   <name>instance-00000008</name>
Jul 24 14:55:14 user nova-compute[70645]:   <uuid>5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</uuid>
Jul 24 14:55:14 user nova-compute[70645]:   <metadata>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:55:14 user nova-compute[70645]:   <nova:package version="0.0.0"/>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:name>tempest-device-tagging-server-896493417</nova:name>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:creationTime>2023-07-24 14:54:57</nova:creationTime>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:flavor name="m1.tiny">
Jul 24 14:55:14 user nova-compute[70645]:     <nova:memory>512</nova:memory>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:disk>1</nova:disk>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:swap>0</nova:swap>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:vcpus>1</nova:vcpus>
Jul 24 14:55:14 user nova-compute[70645]:   </nova:flavor>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:owner>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:user uuid="28e6065f28da456b888cc801f7561b85">tempest-TaggedAttachmentsTest-813130247-project-member</nova:user>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:project uuid="b7e96ad4dba143709ad8715dea63bf23">tempest-TaggedAttachmentsTest-813130247</nova:project>
Jul 24 14:55:14 user nova-compute[70645]:   </nova:owner>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:ports>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:port uuid="bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1">
Jul 24 14:55:14 user nova-compute[70645]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 14:55:14 user nova-compute[70645]:     </nova:port>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:port uuid="d86fc3c3-4140-4680-b72b-439583652c7f">
Jul 24 14:55:14 user nova-compute[70645]:       <nova:ip type="fixed" address="10.10.10.79" ipVersion="4"/>
Jul 24 14:55:14 user nova-compute[70645]:     </nova:port>
Jul 24 14:55:14 user nova-compute[70645]:   </nova:ports>
Jul 24 14:55:14 user nova-compute[70645]: </nova:instance>
Jul 24 14:55:14 user nova-compute[70645]:   </metadata>
Jul 24 14:55:14 user nova-compute[70645]:   <memory unit='KiB'>524288</memory>
Jul 24 14:55:14 user nova-compute[70645]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 24 14:55:14 user nova-compute[70645]:   <vcpu placement='static'>1</vcpu>
Jul 24 14:55:14 user nova-compute[70645]:   <resource>
Jul 24 14:55:14 user nova-compute[70645]:     <partition>/machine</partition>
Jul 24 14:55:14 user nova-compute[70645]:   </resource>
Jul 24 14:55:14 user nova-compute[70645]:   <sysinfo type='smbios'>
Jul 24 14:55:14 user nova-compute[70645]:     <system>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='product'>OpenStack Nova</entry>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='version'>0.0.0</entry>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='serial'>5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</entry>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='uuid'>5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</entry>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='family'>Virtual Machine</entry>
Jul 24 14:55:14 user nova-compute[70645]:     </system>
Jul 24 14:55:14 user nova-compute[70645]:   </sysinfo>
Jul 24 14:55:14 user nova-compute[70645]:   <os>
Jul 24 14:55:14 user nova-compute[70645]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 24 14:55:14 user nova-compute[70645]:     <boot dev='hd'/>
Jul 24 14:55:14 user nova-compute[70645]:     <smbios mode='sysinfo'/>
Jul 24 14:55:14 user nova-compute[70645]:   </os>
Jul 24 14:55:14 user nova-compute[70645]:   <features>
Jul 24 14:55:14 user nova-compute[70645]:     <acpi/>
Jul 24 14:55:14 user nova-compute[70645]:     <apic/>
Jul 24 14:55:14 user nova-compute[70645]:     <vmcoreinfo state='on'/>
Jul 24 14:55:14 user nova-compute[70645]:   </features>
Jul 24 14:55:14 user nova-compute[70645]:   <cpu mode='custom' match='exact' check='full'>
Jul 24 14:55:14 user nova-compute[70645]:     <model fallback='forbid'>Nehalem</model>
Jul 24 14:55:14 user nova-compute[70645]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 24 14:55:14 user nova-compute[70645]:     <feature policy='require' name='vme'/>
Jul 24 14:55:14 user nova-compute[70645]:     <feature policy='require' name='x2apic'/>
Jul 24 14:55:14 user nova-compute[70645]:     <feature policy='require' name='hypervisor'/>
Jul 24 14:55:14 user nova-compute[70645]:   </cpu>
Jul 24 14:55:14 user nova-compute[70645]:   <clock offset='utc'>
Jul 24 14:55:14 user nova-compute[70645]:     <timer name='pit' tickpolicy='delay'/>
Jul 24 14:55:14 user nova-compute[70645]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 24 14:55:14 user nova-compute[70645]:     <timer name='hpet' present='no'/>
Jul 24 14:55:14 user nova-compute[70645]:   </clock>
Jul 24 14:55:14 user nova-compute[70645]:   <on_poweroff>destroy</on_poweroff>
Jul 24 14:55:14 user nova-compute[70645]:   <on_reboot>restart</on_reboot>
Jul 24 14:55:14 user nova-compute[70645]:   <on_crash>destroy</on_crash>
Jul 24 14:55:14 user nova-compute[70645]:   <devices>
Jul 24 14:55:14 user nova-compute[70645]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 14:55:14 user nova-compute[70645]:     <disk type='file' device='disk'>
Jul 24 14:55:14 user nova-compute[70645]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 24 14:55:14 user nova-compute[70645]:       <source file='/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk' index='2'/>
Jul 24 14:55:14 user nova-compute[70645]:       <backingStore type='file' index='3'>
Jul 24 14:55:14 user nova-compute[70645]:         <format type='raw'/>
Jul 24 14:55:14 user nova-compute[70645]:         <source file='/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b'/>
Jul 24 14:55:14 user nova-compute[70645]:         <backingStore/>
Jul 24 14:55:14 user nova-compute[70645]:       </backingStore>
Jul 24 14:55:14 user nova-compute[70645]:       <target dev='vda' bus='virtio'/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='virtio-disk0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </disk>
Jul 24 14:55:14 user nova-compute[70645]:     <disk type='file' device='cdrom'>
Jul 24 14:55:14 user nova-compute[70645]:       <driver name='qemu' type='raw' cache='none'/>
Jul 24 14:55:14 user nova-compute[70645]:       <source file='/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk.config' index='1'/>
Jul 24 14:55:14 user nova-compute[70645]:       <backingStore/>
Jul 24 14:55:14 user nova-compute[70645]:       <target dev='hda' bus='ide'/>
Jul 24 14:55:14 user nova-compute[70645]:       <readonly/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='ide0-0-0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </disk>
Jul 24 14:55:14 user nova-compute[70645]:     <controller type='usb' index='0' model='none'>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='usb'/>
Jul 24 14:55:14 user nova-compute[70645]:     </controller>
Jul 24 14:55:14 user nova-compute[70645]:     <controller type='pci' index='0' model='pci-root'>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='pci.0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </controller>
Jul 24 14:55:14 user nova-compute[70645]:     <controller type='ide' index='0'>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='ide'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 24 14:55:14 user nova-compute[70645]:     </controller>
Jul 24 14:55:14 user nova-compute[70645]:     <interface type='ethernet'>
Jul 24 14:55:14 user nova-compute[70645]:       <mac address='fa:16:3e:32:d0:25'/>
Jul 24 14:55:14 user nova-compute[70645]:       <target dev='tapbfe5f4a4-6a'/>
Jul 24 14:55:14 user nova-compute[70645]:       <model type='virtio'/>
Jul 24 14:55:14 user nova-compute[70645]:       <mtu size='1442'/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='net0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </interface>
Jul 24 14:55:14 user nova-compute[70645]:     <interface type='ethernet'>
Jul 24 14:55:14 user nova-compute[70645]:       <mac address='fa:16:3e:61:23:bd'/>
Jul 24 14:55:14 user nova-compute[70645]:       <target dev='tapd86fc3c3-41'/>
Jul 24 14:55:14 user nova-compute[70645]:       <model type='virtio'/>
Jul 24 14:55:14 user nova-compute[70645]:       <mtu size='1442'/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='net1'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </interface>
Jul 24 14:55:14 user nova-compute[70645]:     <serial type='pty'>
Jul 24 14:55:14 user nova-compute[70645]:       <source path='/dev/pts/7'/>
Jul 24 14:55:14 user nova-compute[70645]:       <log file='/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/console.log' append='off'/>
Jul 24 14:55:14 user nova-compute[70645]:       <target type='isa-serial' port='0'>
Jul 24 14:55:14 user nova-compute[70645]:         <model name='isa-serial'/>
Jul 24 14:55:14 user nova-compute[70645]:       </target>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='serial0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </serial>
Jul 24 14:55:14 user nova-compute[70645]:     <console type='pty' tty='/dev/pts/7'>
Jul 24 14:55:14 user nova-compute[70645]:       <source path='/dev/pts/7'/>
Jul 24 14:55:14 user nova-compute[70645]:       <log file='/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/console.log' append='off'/>
Jul 24 14:55:14 user nova-compute[70645]:       <target type='serial' port='0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='serial0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </console>
Jul 24 14:55:14 user nova-compute[70645]:     <input type='mouse' bus='ps2'>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='input0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </input>
Jul 24 14:55:14 user nova-compute[70645]:     <input type='keyboard' bus='ps2'>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='input1'/>
Jul 24 14:55:14 user nova-compute[70645]:     </input>
Jul 24 14:55:14 user nova-compute[70645]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 24 14:55:14 user nova-compute[70645]:       <listen type='address' address='0.0.0.0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </graphics>
Jul 24 14:55:14 user nova-compute[70645]:     <audio id='1' type='none'/>
Jul 24 14:55:14 user nova-compute[70645]:     <video>
Jul 24 14:55:14 user nova-compute[70645]:       <model type='virtio' heads='1' primary='yes'/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='video0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </video>
Jul 24 14:55:14 user nova-compute[70645]:     <memballoon model='virtio'>
Jul 24 14:55:14 user nova-compute[70645]:       <stats period='10'/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='balloon0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </memballoon>
Jul 24 14:55:14 user nova-compute[70645]:     <rng model='virtio'>
Jul 24 14:55:14 user nova-compute[70645]:       <backend model='random'>/dev/urandom</backend>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='rng0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </rng>
Jul 24 14:55:14 user nova-compute[70645]:   </devices>
Jul 24 14:55:14 user nova-compute[70645]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 24 14:55:14 user nova-compute[70645]:     <label>libvirt-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</label>
Jul 24 14:55:14 user nova-compute[70645]:     <imagelabel>libvirt-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</imagelabel>
Jul 24 14:55:14 user nova-compute[70645]:   </seclabel>
Jul 24 14:55:14 user nova-compute[70645]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 24 14:55:14 user nova-compute[70645]:     <label>+64055:+108</label>
Jul 24 14:55:14 user nova-compute[70645]:     <imagelabel>+64055:+108</imagelabel>
Jul 24 14:55:14 user nova-compute[70645]:   </seclabel>
Jul 24 14:55:14 user nova-compute[70645]: </domain>
Jul 24 14:55:14 user nova-compute[70645]:  {{(pid=70645) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 24 14:55:14 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Successfully detached device tapd86fc3c3-41 from instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 from the persistent domain config.
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] (1/8): Attempting to detach device tapd86fc3c3-41 with device alias net1 from instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] detach device xml: <interface type="ethernet">
Jul 24 14:55:14 user nova-compute[70645]:   <mac address="fa:16:3e:61:23:bd"/>
Jul 24 14:55:14 user nova-compute[70645]:   <model type="virtio"/>
Jul 24 14:55:14 user nova-compute[70645]:   <mtu size="1442"/>
Jul 24 14:55:14 user nova-compute[70645]:   <target dev="tapd86fc3c3-41"/>
Jul 24 14:55:14 user nova-compute[70645]: </interface>
Jul 24 14:55:14 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3755fd7f-5408-4114-9b61-4eb501e02d1d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hDgUkXsN {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hDgUkXsN" returned: 0 in 0.033s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f23ee74-6adc-498e-92ee-5f586bdfcf66]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hDgUkXsN'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfca629a-d6da-4e48-bd3a-4e9e343d8eb9]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d914d1c8-ea40-4b5c-8311-c3c2e8d63dd9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:14 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:14 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db052a0-3d2d-4ecb-9dc2-55cdad12853e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8, portal: 172.16.0.220,3260]
Jul 24 14:55:14 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:14 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[844b7624-4b6b-47a0-bde0-65e563e721d2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98fa92d-9bee-46a9-9571-6aea236018a3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:14 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:14 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:14 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690210514.6343193, 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Start waiting for the detach event from libvirt for device tapd86fc3c3-41 with device alias net1 for instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:61:23:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapd86fc3c3-41"/></interface> {{(pid=70645) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:61:23:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapd86fc3c3-41"/></interface>not found in domain: <domain type='kvm' id='8'>
Jul 24 14:55:14 user nova-compute[70645]:   <name>instance-00000008</name>
Jul 24 14:55:14 user nova-compute[70645]:   <uuid>5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</uuid>
Jul 24 14:55:14 user nova-compute[70645]:   <metadata>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:55:14 user nova-compute[70645]:   <nova:package version="0.0.0"/>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:name>tempest-device-tagging-server-896493417</nova:name>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:creationTime>2023-07-24 14:54:57</nova:creationTime>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:flavor name="m1.tiny">
Jul 24 14:55:14 user nova-compute[70645]:     <nova:memory>512</nova:memory>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:disk>1</nova:disk>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:swap>0</nova:swap>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:vcpus>1</nova:vcpus>
Jul 24 14:55:14 user nova-compute[70645]:   </nova:flavor>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:owner>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:user uuid="28e6065f28da456b888cc801f7561b85">tempest-TaggedAttachmentsTest-813130247-project-member</nova:user>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:project uuid="b7e96ad4dba143709ad8715dea63bf23">tempest-TaggedAttachmentsTest-813130247</nova:project>
Jul 24 14:55:14 user nova-compute[70645]:   </nova:owner>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:ports>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:port uuid="bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1">
Jul 24 14:55:14 user nova-compute[70645]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 14:55:14 user nova-compute[70645]:     </nova:port>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:port uuid="d86fc3c3-4140-4680-b72b-439583652c7f">
Jul 24 14:55:14 user nova-compute[70645]:       <nova:ip type="fixed" address="10.10.10.79" ipVersion="4"/>
Jul 24 14:55:14 user nova-compute[70645]:     </nova:port>
Jul 24 14:55:14 user nova-compute[70645]:   </nova:ports>
Jul 24 14:55:14 user nova-compute[70645]: </nova:instance>
Jul 24 14:55:14 user nova-compute[70645]:   </metadata>
Jul 24 14:55:14 user nova-compute[70645]:   <memory unit='KiB'>524288</memory>
Jul 24 14:55:14 user nova-compute[70645]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 24 14:55:14 user nova-compute[70645]:   <vcpu placement='static'>1</vcpu>
Jul 24 14:55:14 user nova-compute[70645]:   <resource>
Jul 24 14:55:14 user nova-compute[70645]:     <partition>/machine</partition>
Jul 24 14:55:14 user nova-compute[70645]:   </resource>
Jul 24 14:55:14 user nova-compute[70645]:   <sysinfo type='smbios'>
Jul 24 14:55:14 user nova-compute[70645]:     <system>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='product'>OpenStack Nova</entry>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='version'>0.0.0</entry>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='serial'>5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</entry>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='uuid'>5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</entry>
Jul 24 14:55:14 user nova-compute[70645]:       <entry name='family'>Virtual Machine</entry>
Jul 24 14:55:14 user nova-compute[70645]:     </system>
Jul 24 14:55:14 user nova-compute[70645]:   </sysinfo>
Jul 24 14:55:14 user nova-compute[70645]:   <os>
Jul 24 14:55:14 user nova-compute[70645]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 24 14:55:14 user nova-compute[70645]:     <boot dev='hd'/>
Jul 24 14:55:14 user nova-compute[70645]:     <smbios mode='sysinfo'/>
Jul 24 14:55:14 user nova-compute[70645]:   </os>
Jul 24 14:55:14 user nova-compute[70645]:   <features>
Jul 24 14:55:14 user nova-compute[70645]:     <acpi/>
Jul 24 14:55:14 user nova-compute[70645]:     <apic/>
Jul 24 14:55:14 user nova-compute[70645]:     <vmcoreinfo state='on'/>
Jul 24 14:55:14 user nova-compute[70645]:   </features>
Jul 24 14:55:14 user nova-compute[70645]:   <cpu mode='custom' match='exact' check='full'>
Jul 24 14:55:14 user nova-compute[70645]:     <model fallback='forbid'>Nehalem</model>
Jul 24 14:55:14 user nova-compute[70645]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 24 14:55:14 user nova-compute[70645]:     <feature policy='require' name='vme'/>
Jul 24 14:55:14 user nova-compute[70645]:     <feature policy='require' name='x2apic'/>
Jul 24 14:55:14 user nova-compute[70645]:     <feature policy='require' name='hypervisor'/>
Jul 24 14:55:14 user nova-compute[70645]:   </cpu>
Jul 24 14:55:14 user nova-compute[70645]:   <clock offset='utc'>
Jul 24 14:55:14 user nova-compute[70645]:     <timer name='pit' tickpolicy='delay'/>
Jul 24 14:55:14 user nova-compute[70645]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 24 14:55:14 user nova-compute[70645]:     <timer name='hpet' present='no'/>
Jul 24 14:55:14 user nova-compute[70645]:   </clock>
Jul 24 14:55:14 user nova-compute[70645]:   <on_poweroff>destroy</on_poweroff>
Jul 24 14:55:14 user nova-compute[70645]:   <on_reboot>restart</on_reboot>
Jul 24 14:55:14 user nova-compute[70645]:   <on_crash>destroy</on_crash>
Jul 24 14:55:14 user nova-compute[70645]:   <devices>
Jul 24 14:55:14 user nova-compute[70645]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 14:55:14 user nova-compute[70645]:     <disk type='file' device='disk'>
Jul 24 14:55:14 user nova-compute[70645]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 24 14:55:14 user nova-compute[70645]:       <source file='/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk' index='2'/>
Jul 24 14:55:14 user nova-compute[70645]:       <backingStore type='file' index='3'>
Jul 24 14:55:14 user nova-compute[70645]:         <format type='raw'/>
Jul 24 14:55:14 user nova-compute[70645]:         <source file='/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b'/>
Jul 24 14:55:14 user nova-compute[70645]:         <backingStore/>
Jul 24 14:55:14 user nova-compute[70645]:       </backingStore>
Jul 24 14:55:14 user nova-compute[70645]:       <target dev='vda' bus='virtio'/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='virtio-disk0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </disk>
Jul 24 14:55:14 user nova-compute[70645]:     <disk type='file' device='cdrom'>
Jul 24 14:55:14 user nova-compute[70645]:       <driver name='qemu' type='raw' cache='none'/>
Jul 24 14:55:14 user nova-compute[70645]:       <source file='/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk.config' index='1'/>
Jul 24 14:55:14 user nova-compute[70645]:       <backingStore/>
Jul 24 14:55:14 user nova-compute[70645]:       <target dev='hda' bus='ide'/>
Jul 24 14:55:14 user nova-compute[70645]:       <readonly/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='ide0-0-0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </disk>
Jul 24 14:55:14 user nova-compute[70645]:     <controller type='usb' index='0' model='none'>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='usb'/>
Jul 24 14:55:14 user nova-compute[70645]:     </controller>
Jul 24 14:55:14 user nova-compute[70645]:     <controller type='pci' index='0' model='pci-root'>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='pci.0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </controller>
Jul 24 14:55:14 user nova-compute[70645]:     <controller type='ide' index='0'>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='ide'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 24 14:55:14 user nova-compute[70645]:     </controller>
Jul 24 14:55:14 user nova-compute[70645]:     <interface type='ethernet'>
Jul 24 14:55:14 user nova-compute[70645]:       <mac address='fa:16:3e:32:d0:25'/>
Jul 24 14:55:14 user nova-compute[70645]:       <target dev='tapbfe5f4a4-6a'/>
Jul 24 14:55:14 user nova-compute[70645]:       <model type='virtio'/>
Jul 24 14:55:14 user nova-compute[70645]:       <mtu size='1442'/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='net0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </interface>
Jul 24 14:55:14 user nova-compute[70645]:     <serial type='pty'>
Jul 24 14:55:14 user nova-compute[70645]:       <source path='/dev/pts/7'/>
Jul 24 14:55:14 user nova-compute[70645]:       <log file='/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/console.log' append='off'/>
Jul 24 14:55:14 user nova-compute[70645]:       <target type='isa-serial' port='0'>
Jul 24 14:55:14 user nova-compute[70645]:         <model name='isa-serial'/>
Jul 24 14:55:14 user nova-compute[70645]:       </target>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='serial0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </serial>
Jul 24 14:55:14 user nova-compute[70645]:     <console type='pty' tty='/dev/pts/7'>
Jul 24 14:55:14 user nova-compute[70645]:       <source path='/dev/pts/7'/>
Jul 24 14:55:14 user nova-compute[70645]:       <log file='/opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/console.log' append='off'/>
Jul 24 14:55:14 user nova-compute[70645]:       <target type='serial' port='0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='serial0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </console>
Jul 24 14:55:14 user nova-compute[70645]:     <input type='mouse' bus='ps2'>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='input0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </input>
Jul 24 14:55:14 user nova-compute[70645]:     <input type='keyboard' bus='ps2'>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='input1'/>
Jul 24 14:55:14 user nova-compute[70645]:     </input>
Jul 24 14:55:14 user nova-compute[70645]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 24 14:55:14 user nova-compute[70645]:       <listen type='address' address='0.0.0.0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </graphics>
Jul 24 14:55:14 user nova-compute[70645]:     <audio id='1' type='none'/>
Jul 24 14:55:14 user nova-compute[70645]:     <video>
Jul 24 14:55:14 user nova-compute[70645]:       <model type='virtio' heads='1' primary='yes'/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='video0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </video>
Jul 24 14:55:14 user nova-compute[70645]:     <memballoon model='virtio'>
Jul 24 14:55:14 user nova-compute[70645]:       <stats period='10'/>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='balloon0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </memballoon>
Jul 24 14:55:14 user nova-compute[70645]:     <rng model='virtio'>
Jul 24 14:55:14 user nova-compute[70645]:       <backend model='random'>/dev/urandom</backend>
Jul 24 14:55:14 user nova-compute[70645]:       <alias name='rng0'/>
Jul 24 14:55:14 user nova-compute[70645]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 24 14:55:14 user nova-compute[70645]:     </rng>
Jul 24 14:55:14 user nova-compute[70645]:   </devices>
Jul 24 14:55:14 user nova-compute[70645]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 24 14:55:14 user nova-compute[70645]:     <label>libvirt-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</label>
Jul 24 14:55:14 user nova-compute[70645]:     <imagelabel>libvirt-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1</imagelabel>
Jul 24 14:55:14 user nova-compute[70645]:   </seclabel>
Jul 24 14:55:14 user nova-compute[70645]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 24 14:55:14 user nova-compute[70645]:     <label>+64055:+108</label>
Jul 24 14:55:14 user nova-compute[70645]:     <imagelabel>+64055:+108</imagelabel>
Jul 24 14:55:14 user nova-compute[70645]:   </seclabel>
Jul 24 14:55:14 user nova-compute[70645]: </domain>
Jul 24 14:55:14 user nova-compute[70645]:  {{(pid=70645) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 24 14:55:14 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Successfully detached device tapd86fc3c3-41 from instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 from the live domain config.
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-896493417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-896493417',id=8,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOC+pbtS3b10zgGPN8jzEAGTj3Lutj6NjqD/u3q2th61GdXcNYKMiu+ZkghxLk9jByTpKK5pKCNa5736mrWQiHDLOInWyMhYDKqT7SxK/aJuuMMC5WiwiwkOIdnj15Mqg==',key_name='tempest-keypair-1737242635',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7e96ad4dba143709ad8715dea63bf23',ramdisk_id='',reservation_id='r-wle60jho',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-813130247',owner_user_name='tempest-TaggedAttachmentsTest-813130247-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28e6065f28da456b888cc801f7561b85',uuid=5f355cfc-9d1b-4f2b-936b-e28a65bd99e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d86fc3c3-4140-4680-b72b-439583652c7f", "address": "fa:16:3e:61:23:bd", "network": {"id": "c7f79393-5e5e-48f8-999f-b74a41796eed", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1611956044", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86fc3c3-41", "ovs_interfaceid": "d86fc3c3-4140-4680-b72b-439583652c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converting VIF {"id": "d86fc3c3-4140-4680-b72b-439583652c7f", "address": "fa:16:3e:61:23:bd", "network": {"id": "c7f79393-5e5e-48f8-999f-b74a41796eed", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1611956044", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86fc3c3-41", "ovs_interfaceid": "d86fc3c3-4140-4680-b72b-439583652c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:23:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86fc3c3-4140-4680-b72b-439583652c7f,network=Network(c7f79393-5e5e-48f8-999f-b74a41796eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86fc3c3-41') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_vif [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:23:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86fc3c3-4140-4680-b72b-439583652c7f,network=Network(c7f79393-5e5e-48f8-999f-b74a41796eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86fc3c3-41') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd86fc3c3-41, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.032s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbe060a-58e9-4bc9-8f58-aeffb1b9a9f0]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDgUkXsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:14 user nova-compute[70645]: INFO os_vif [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:23:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86fc3c3-4140-4680-b72b-439583652c7f,network=Network(c7f79393-5e5e-48f8-999f-b74a41796eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86fc3c3-41')
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:55:14 user nova-compute[70645]:   <nova:package version="0.0.0"/>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:name>tempest-device-tagging-server-896493417</nova:name>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:creationTime>2023-07-24 14:55:14</nova:creationTime>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:flavor name="m1.tiny">
Jul 24 14:55:14 user nova-compute[70645]:     <nova:memory>512</nova:memory>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:disk>1</nova:disk>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:swap>0</nova:swap>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:vcpus>1</nova:vcpus>
Jul 24 14:55:14 user nova-compute[70645]:   </nova:flavor>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:owner>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:user uuid="28e6065f28da456b888cc801f7561b85">tempest-TaggedAttachmentsTest-813130247-project-member</nova:user>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:project uuid="b7e96ad4dba143709ad8715dea63bf23">tempest-TaggedAttachmentsTest-813130247</nova:project>
Jul 24 14:55:14 user nova-compute[70645]:   </nova:owner>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:55:14 user nova-compute[70645]:   <nova:ports>
Jul 24 14:55:14 user nova-compute[70645]:     <nova:port uuid="bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1">
Jul 24 14:55:14 user nova-compute[70645]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 14:55:14 user nova-compute[70645]:     </nova:port>
Jul 24 14:55:14 user nova-compute[70645]:   </nova:ports>
Jul 24 14:55:14 user nova-compute[70645]: </nova:instance>
Jul 24 14:55:14 user nova-compute[70645]:  {{(pid=70645) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-2ec0b173-d7f8-4975-b0ac-a82b23083668 req-2c65b6b1-f6bc-433c-b2a1-cc882a457e28 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-vif-unplugged-d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2ec0b173-d7f8-4975-b0ac-a82b23083668 req-2c65b6b1-f6bc-433c-b2a1-cc882a457e28 service nova] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2ec0b173-d7f8-4975-b0ac-a82b23083668 req-2c65b6b1-f6bc-433c-b2a1-cc882a457e28 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2ec0b173-d7f8-4975-b0ac-a82b23083668 req-2c65b6b1-f6bc-433c-b2a1-cc882a457e28 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-2ec0b173-d7f8-4975-b0ac-a82b23083668 req-2c65b6b1-f6bc-433c-b2a1-cc882a457e28 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] No waiting events found dispatching network-vif-unplugged-d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:14 user nova-compute[70645]: WARNING nova.compute.manager [req-2ec0b173-d7f8-4975-b0ac-a82b23083668 req-2c65b6b1-f6bc-433c-b2a1-cc882a457e28 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received unexpected event network-vif-unplugged-d86fc3c3-4140-4680-b72b-439583652c7f for instance with vm_state active and task_state None.
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:14 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquired lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG nova.network.neutron [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23065326130376562', 'path': '/dev/sdi'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065326130376562', 'path': '/dev/sdi'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG nova.objects.instance [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lazy-loading 'flavor' on Instance uuid a816f335-7f2e-4121-9667-237b22349724 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:55:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:16 user nova-compute[70645]: INFO nova.network.neutron [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Port d86fc3c3-4140-4680-b72b-439583652c7f from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.network.neutron [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updating instance_info_cache with network_info: [{"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Releasing lock "refresh_cache-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b8f06926-6156-4ef8-bb02-4d3a7de68c47 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "interface-5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-d86fc3c3-4140-4680-b72b-439583652c7f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.806s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 175112192 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-3630ceda-1cb9-434d-97d6-1a7d79bd3924 req-fa9d20c4-7bbc-40b9-aa7e-07675649105b service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-vif-plugged-d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3630ceda-1cb9-434d-97d6-1a7d79bd3924 req-fa9d20c4-7bbc-40b9-aa7e-07675649105b service nova] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3630ceda-1cb9-434d-97d6-1a7d79bd3924 req-fa9d20c4-7bbc-40b9-aa7e-07675649105b service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3630ceda-1cb9-434d-97d6-1a7d79bd3924 req-fa9d20c4-7bbc-40b9-aa7e-07675649105b service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-3630ceda-1cb9-434d-97d6-1a7d79bd3924 req-fa9d20c4-7bbc-40b9-aa7e-07675649105b service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] No waiting events found dispatching network-vif-plugged-d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:16 user nova-compute[70645]: WARNING nova.compute.manager [req-3630ceda-1cb9-434d-97d6-1a7d79bd3924 req-fa9d20c4-7bbc-40b9-aa7e-07675649105b service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received unexpected event network-vif-plugged-d86fc3c3-4140-4680-b72b-439583652c7f for instance with vm_state active and task_state None.
Jul 24 14:55:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-3630ceda-1cb9-434d-97d6-1a7d79bd3924 req-fa9d20c4-7bbc-40b9-aa7e-07675649105b service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-vif-deleted-d86fc3c3-4140-4680-b72b-439583652c7f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 339738624 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:18 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:55:18 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7285MB free_disk=25.797908782958984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 641728512 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 046adfbd-fa5f-45f5-ae62-ddc0f834d450 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance f1a667e2-7992-44e4-9500-fa598493e173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance a816f335-7f2e-4121-9667-237b22349724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance d2c5d524-aade-4229-b12a-f953c25eaa40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 2518724a-a4f8-44e6-8820-1019289e65fc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance dd796d18-9a13-40b8-9f4e-0a9dd93d4149 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance ff0bb392-a296-45a0-a102-f8b0e1c9d41a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 766509056 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:55:18 user nova-compute[70645]: INFO nova.compute.claims [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Claim successful on node user
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210503.9436796, 07268543-d6a3-479b-a4b9-e0cc87bb068a => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:55:18 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] VM Stopped (Lifecycle Event)
Jul 24 14:55:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-746bc934-f6d4-4036-b2e6-4c5409575962 None None] [instance: 07268543-d6a3-479b-a4b9-e0cc87bb068a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 938475520 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.network.neutron [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:55:19 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:55:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:55:19 user nova-compute[70645]: INFO nova.virt.block_device [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Booting with blank volume at /dev/vda
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.policy [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '192b7bd8dd234dceadc22ba7bb092344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab8baa391424072ba5bcea7f54f0242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEfAbcXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:19 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c74bdf-bfac-4dc3-a7b9-4b71fca0a6f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b7e37d-4202-4da4-8014-c5d7b4b0c67d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:19 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:19 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:19 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba846797e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d'): ({'sdk'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Removing single pathed devices sdk {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[339acca2-8e18-49f5-bca9-6c18f8d43ec5]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc33af8-6dd6-4f49-be72-a67bd34fbba9]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Flushing IO for device /dev/sdk {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[039435a0-dd60-4f01-aebf-b28fe470989e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:55:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.062s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6f96ad-2909-4e87-9107-85f35c8a94a5]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] SCSI volumes sdk have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e60339-9f7e-4dea-9f87-cec7c5719521]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.107s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c0b835-a61b-44cf-93fa-821b75b13c72]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260]
Jul 24 14:55:20 user nova-compute[70645]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:20 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb33aa6-a4cc-459b-a5d9-5f41648c2555]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] <== disconnect_volume: return (428ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDgUkXsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'a816f335-7f2e-4121-9667-237b22349724', 'attached_at': '', 'detached_at': '', 'volume_id': '56427b94-10c4-4a08-bc13-0d2a081390c8', 'serial'} {{(pid=70645) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] swap_volume: removing Cinder connection for volume 317500b2-0855-4b5d-8697-2df652366e5d {{(pid=70645) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG nova.network.neutron [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Successfully created port: 376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Updating instance_info_cache with network_info: [{"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-046adfbd-fa5f-45f5-ae62-ddc0f834d450" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:55:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG nova.network.neutron [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Successfully updated port: 376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquired lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG nova.network.neutron [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-fedbd356-1055-4ac6-9429-085b865ceab9 req-51e0532a-9771-492d-a64a-c99831a9f1be service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-changed-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-fedbd356-1055-4ac6-9429-085b865ceab9 req-51e0532a-9771-492d-a64a-c99831a9f1be service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Refreshing instance network info cache due to event network-changed-376b3d27-e524-41f9-916f-1a3901da8eec. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fedbd356-1055-4ac6-9429-085b865ceab9 req-51e0532a-9771-492d-a64a-c99831a9f1be service nova] Acquiring lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG nova.network.neutron [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG nova.network.neutron [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Updating instance_info_cache with network_info: [{"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Releasing lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG nova.compute.manager [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Instance network_info: |[{"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fedbd356-1055-4ac6-9429-085b865ceab9 req-51e0532a-9771-492d-a64a-c99831a9f1be service nova] Acquired lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG nova.network.neutron [req-fedbd356-1055-4ac6-9429-085b865ceab9 req-51e0532a-9771-492d-a64a-c99831a9f1be service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Refreshing network info cache for port 376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:55:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:22 user nova-compute[70645]: DEBUG nova.network.neutron [req-fedbd356-1055-4ac6-9429-085b865ceab9 req-51e0532a-9771-492d-a64a-c99831a9f1be service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Updated VIF entry in instance network info cache for port 376b3d27-e524-41f9-916f-1a3901da8eec. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:55:22 user nova-compute[70645]: DEBUG nova.network.neutron [req-fedbd356-1055-4ac6-9429-085b865ceab9 req-51e0532a-9771-492d-a64a-c99831a9f1be service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Updating instance_info_cache with network_info: [{"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fedbd356-1055-4ac6-9429-085b865ceab9 req-51e0532a-9771-492d-a64a-c99831a9f1be service nova] Releasing lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:55:22 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210507.7850096, ea55b3b9-4821-4400-b99f-ba233c2a7395 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:55:22 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] VM Stopped (Lifecycle Event)
Jul 24 14:55:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1f49a4ff-e5dd-4335-b74d-8d5c4180a3c6 None None] [instance: ea55b3b9-4821-4400-b99f-ba233c2a7395] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] swap_volume: Updating volume 317500b2-0855-4b5d-8697-2df652366e5d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "hDgUkXsN", "auth_password": "PJiSgdFRpVwC3G", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "56427b94-10c4-4a08-bc13-0d2a081390c8"}, "status": "reserved", "instance": "a816f335-7f2e-4121-9667-237b22349724", "attached_at": "", "detached_at": "", "volume_id": "56427b94-10c4-4a08-bc13-0d2a081390c8", "serial": "56427b94-10c4-4a08-bc13-0d2a081390c8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '56427b94-10c4-4a08-bc13-0d2a081390c8', 'no_device': None, 'attachment_id': '7499d960-c9f8-486b-a36f-60120f912105'} {{(pid=70645) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 24 14:55:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-28c094f8-7a2f-4306-b50d-4503bb38f138 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "a816f335-7f2e-4121-9667-237b22349724" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.866s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "a816f335-7f2e-4121-9667-237b22349724" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG os_brick.utils [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[503e833e-61fa-494e-9bee-45f79e2f3213]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66d7665-d4cd-4f6b-a8d9-73bbfe859c09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56bf48b-de5f-43a1-9967-41e82a454b4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdc08c3-7c42-416d-bfe6-6b0b02d5ce78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:55:24 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:55:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d49032-ef7f-4061-a147-7a6bf656b30f]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:55:24 user nova-compute[70645]: DEBUG os_brick.utils [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:24 user nova-compute[70645]: INFO nova.compute.manager [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] Swapping volume 56427b94-10c4-4a08-bc13-0d2a081390c8 for 317500b2-0855-4b5d-8697-2df652366e5d
Jul 24 14:55:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG os_brick.utils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bc0c69-fd85-478e-a1fd-f181593277f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6cd2b1-cc4d-4efc-b08b-2e3fd1ab19da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[927c5214-129d-42f8-abdc-0db0f45ac839]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa1d4fb-6f99-4794-b80a-206ce27118d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:55:25 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:55:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca9e368-0939-4898-a91f-a2358ebfebe3]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG os_brick.utils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:25 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Updating existing volume attachment record: fc0a4a79-e5ec-4d5d-9c74-2b2cc84f8d65 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:55:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEfAbcXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a816f335-7f2e-4121-9667-237b22349724', 'attached_at': '', 'detached_at': '', 'volume_id': '317500b2-0855-4b5d-8697-2df652366e5d', 'serial': '317500b2-0855-4b5d-8697-2df652366e5d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDgUkXsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '56427b94-10c4-4a08-bc13-0d2a081390c8'}, 'status': 'reserved', 'instance': 'a816f335-7f2e-4121-9667-237b22349724', 'attached_at': '', 'detached_at': '', 'volume_id': '56427b94-10c4-4a08-bc13-0d2a081390c8', 'serial'} {{(pid=70645) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEfAbcXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:31 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:31 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:31 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2d61ea-802a-4dad-8c72-cf73ba854d51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:55:31 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f75013c-e0e1-4327-9196-a7a6b4a0f4ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d] added
Jul 24 14:55:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a795aa53-df2f-42dc-99a7-6e9a641d9d22]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1162512-3d99-4a3e-827f-29a6763f395f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEfAbcXZ {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEfAbcXZ" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af61400-d56d-4c97-8dfd-4927ce2de90c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VEfAbcXZ'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4571f130-4427-4bcb-a16a-15665a1eac1f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[003401ab-8e4c-4755-b4c3-2383dc05e266]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40a67fa-cd07-4cb1-9c3b-573fc05ab23e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260]
Jul 24 14:55:32 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d731a5-8a82-4a5b-ac26-cb9bec22defe]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdabda30-a2d5-45da-98b5-d5086dff7626]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:32 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] HCTL ('41', '-', '-', 0) found on session 15 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0242ccd2-8e3e-4b7d-8168-81687c357706]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:55:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEfAbcXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23931383730343038', 'path': '/dev/sdj'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931383730343038', 'path': '/dev/sdj'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.objects.instance [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lazy-loading 'flavor' on Instance uuid a816f335-7f2e-4121-9667-237b22349724 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:55:33 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Creating image(s)
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Ensure instance console log exists: /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Start _get_guest_xml network_info=[{"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fc0a4a79-e5ec-4d5d-9c74-2b2cc84f8d65', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROnGTIAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10b586d2-6bff-4cb5-bde5-b8fdc035ff07', 'attached_at': '', 'detached_at': '', 'volume_id': 'a968748b-0bec-460a-bb02-bc7d4774f0c3', 'serial': 'a968748b-0bec-460a-bb02-bc7d4774f0c3'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:55:33 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:55:33 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROnGTIAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:33 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:33 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:33 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[30051a17-cb83-4619-a518-2979db32d3bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:55:33 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2457e56c-84eb-4143-b5e7-051ecf5bf71d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3] added
Jul 24 14:55:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[779b62cb-609e-4642-be72-840421ad194b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fd1686-2243-4ac2-88a6-f7d35c1e81fa]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ROnGTIAe {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ROnGTIAe" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b166e896-1975-4f95-8256-8229d9085c32]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ROnGTIAe'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dee154a-b4df-4706-9e82-00bdafaec4c0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b73c582-ebc3-489d-a297-6393b8d65868]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[91630244-f435-4cbf-8e9e-0eabc9a3c5e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3, portal: 172.16.0.220,3260]
Jul 24 14:55:33 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dd93b0-5e6c-4c78-876e-2c2e564ddf60]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[22745764-b65f-4fdc-b769-5277c4d2df95]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:33 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] HCTL ('42', '-', '-', 0) found on session 16 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3a703e-6f75-44f6-af03-e4293c796636]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching for a device in session 16 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:55:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROnGTIAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:55:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 158334976 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 340787200 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '26134343735393166', 'path': '/dev/sdk'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134343735393166', 'path': '/dev/sdk'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1295668391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1295668391',id=13,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-fe9sxf4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:55:20Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=10b586d2-6bff-4cb5-bde5-b8fdc035ff07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:0f:85,bridge_name='br-int',has_traffic_filtering=True,id=376b3d27-e524-41f9-916f-1a3901da8eec,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376b3d27-e5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.objects.instance [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'pci_devices' on Instance uuid 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:55:35 user nova-compute[70645]:   <uuid>10b586d2-6bff-4cb5-bde5-b8fdc035ff07</uuid>
Jul 24 14:55:35 user nova-compute[70645]:   <name>instance-0000000d</name>
Jul 24 14:55:35 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:55:35 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:55:35 user nova-compute[70645]:   <metadata>
Jul 24 14:55:35 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:55:35 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:55:35 user nova-compute[70645]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1295668391</nova:name>
Jul 24 14:55:35 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:55:33</nova:creationTime>
Jul 24 14:55:35 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:55:35 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:55:35 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:55:35 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:55:35 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:55:35 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:55:35 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:55:35 user nova-compute[70645]:       <nova:owner>
Jul 24 14:55:35 user nova-compute[70645]:         <nova:user uuid="192b7bd8dd234dceadc22ba7bb092344">tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member</nova:user>
Jul 24 14:55:35 user nova-compute[70645]:         <nova:project uuid="bab8baa391424072ba5bcea7f54f0242">tempest-ServerBootFromVolumeStableRescueTest-1550895590</nova:project>
Jul 24 14:55:35 user nova-compute[70645]:       </nova:owner>
Jul 24 14:55:35 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:55:35 user nova-compute[70645]:       <nova:ports>
Jul 24 14:55:35 user nova-compute[70645]:         <nova:port uuid="376b3d27-e524-41f9-916f-1a3901da8eec">
Jul 24 14:55:35 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 14:55:35 user nova-compute[70645]:         </nova:port>
Jul 24 14:55:35 user nova-compute[70645]:       </nova:ports>
Jul 24 14:55:35 user nova-compute[70645]:     </nova:instance>
Jul 24 14:55:35 user nova-compute[70645]:   </metadata>
Jul 24 14:55:35 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:55:35 user nova-compute[70645]:     <system>
Jul 24 14:55:35 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:55:35 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:55:35 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:55:35 user nova-compute[70645]:       <entry name="serial">10b586d2-6bff-4cb5-bde5-b8fdc035ff07</entry>
Jul 24 14:55:35 user nova-compute[70645]:       <entry name="uuid">10b586d2-6bff-4cb5-bde5-b8fdc035ff07</entry>
Jul 24 14:55:35 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:55:35 user nova-compute[70645]:     </system>
Jul 24 14:55:35 user nova-compute[70645]:   </sysinfo>
Jul 24 14:55:35 user nova-compute[70645]:   <os>
Jul 24 14:55:35 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:55:35 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:55:35 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:55:35 user nova-compute[70645]:   </os>
Jul 24 14:55:35 user nova-compute[70645]:   <features>
Jul 24 14:55:35 user nova-compute[70645]:     <acpi/>
Jul 24 14:55:35 user nova-compute[70645]:     <apic/>
Jul 24 14:55:35 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:55:35 user nova-compute[70645]:   </features>
Jul 24 14:55:35 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:55:35 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:55:35 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:55:35 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:55:35 user nova-compute[70645]:   </clock>
Jul 24 14:55:35 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:55:35 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:55:35 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:55:35 user nova-compute[70645]:   </cpu>
Jul 24 14:55:35 user nova-compute[70645]:   <devices>
Jul 24 14:55:35 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 14:55:35 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:35 user nova-compute[70645]:       <source dev="/dev/sdk"/>
Jul 24 14:55:35 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:55:35 user nova-compute[70645]:       <serial>a968748b-0bec-460a-bb02-bc7d4774f0c3</serial>
Jul 24 14:55:35 user nova-compute[70645]:     </disk>
Jul 24 14:55:35 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:55:35 user nova-compute[70645]:       <mac address="fa:16:3e:a2:0f:85"/>
Jul 24 14:55:35 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:55:35 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:55:35 user nova-compute[70645]:       <target dev="tap376b3d27-e5"/>
Jul 24 14:55:35 user nova-compute[70645]:     </interface>
Jul 24 14:55:35 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:55:35 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/console.log" append="off"/>
Jul 24 14:55:35 user nova-compute[70645]:     </serial>
Jul 24 14:55:35 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:55:35 user nova-compute[70645]:     <video>
Jul 24 14:55:35 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:55:35 user nova-compute[70645]:     </video>
Jul 24 14:55:35 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:55:35 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:55:35 user nova-compute[70645]:     </rng>
Jul 24 14:55:35 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:55:35 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:55:35 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:55:35 user nova-compute[70645]:     </memballoon>
Jul 24 14:55:35 user nova-compute[70645]:   </devices>
Jul 24 14:55:35 user nova-compute[70645]: </domain>
Jul 24 14:55:35 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1295668391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1295668391',id=13,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-fe9sxf4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:55:20Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=10b586d2-6bff-4cb5-bde5-b8fdc035ff07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:0f:85,bridge_name='br-int',has_traffic_filtering=True,id=376b3d27-e524-41f9-916f-1a3901da8eec,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376b3d27-e5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG os_vif [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:0f:85,bridge_name='br-int',has_traffic_filtering=True,id=376b3d27-e524-41f9-916f-1a3901da8eec,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376b3d27-e5') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap376b3d27-e5, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap376b3d27-e5, col_values=(('external_ids', {'iface-id': '376b3d27-e524-41f9-916f-1a3901da8eec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:0f:85', 'vm-uuid': '10b586d2-6bff-4cb5-bde5-b8fdc035ff07'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:35 user nova-compute[70645]: INFO os_vif [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:0f:85,bridge_name='br-int',has_traffic_filtering=True,id=376b3d27-e524-41f9-916f-1a3901da8eec,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376b3d27-e5')
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 486539264 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No VIF found with MAC fa:16:3e:a2:0f:85, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:55:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 662700032 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 834666496 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 1003487232 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-8af8b0ab-2518-4020-aeb1-e19c566e9389 req-cb37a4a2-95ec-4f10-a11e-ecadffc7b9f5 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8af8b0ab-2518-4020-aeb1-e19c566e9389 req-cb37a4a2-95ec-4f10-a11e-ecadffc7b9f5 service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8af8b0ab-2518-4020-aeb1-e19c566e9389 req-cb37a4a2-95ec-4f10-a11e-ecadffc7b9f5 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8af8b0ab-2518-4020-aeb1-e19c566e9389 req-cb37a4a2-95ec-4f10-a11e-ecadffc7b9f5 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-8af8b0ab-2518-4020-aeb1-e19c566e9389 req-cb37a4a2-95ec-4f10-a11e-ecadffc7b9f5 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:36 user nova-compute[70645]: WARNING nova.compute.manager [req-8af8b0ab-2518-4020-aeb1-e19c566e9389 req-cb37a4a2-95ec-4f10-a11e-ecadffc7b9f5 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received unexpected event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with vm_state building and task_state spawning.
Jul 24 14:55:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDgUkXsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '56427b94-10c4-4a08-bc13-0d2a081390c8'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:37 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[924d75b7-ec1b-4d53-aedc-83d562e78f0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f805ab8-7a04-46be-9844-9fd5c189b621]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:37 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:37 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:37 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba942cde10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8'): ({'sdi'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Removing single pathed devices sdi {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[322a369b-6734-4e8d-bcbd-163865196ae8]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c763f7-b459-493e-b6e0-0820a31e753c]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Flushing IO for device /dev/sdi {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5e98b9-9ee0-4ad3-aa5d-b76924e0b207]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5a9ff4-b4e2-4bd7-b814-e950951b433f]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] SCSI volumes sdi have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b1e08f-6787-4f00-8e41-a016431821a2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b881c0e3-60da-4a94-ba4d-4e079b90c641]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8, portal: 172.16.0.220,3260]
Jul 24 14:55:37 user nova-compute[70645]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:37 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56427b94-10c4-4a08-bc13-0d2a081390c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[34882307-4b83-4a11-acb8-c820b31dd46a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] <== disconnect_volume: return (391ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEfAbcXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'a816f335-7f2e-4121-9667-237b22349724', 'attached_at': '', 'detached_at': '', 'volume_id': '317500b2-0855-4b5d-8697-2df652366e5d', 'serial'} {{(pid=70645) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 24 14:55:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] swap_volume: removing Cinder connection for volume 56427b94-10c4-4a08-bc13-0d2a081390c8 {{(pid=70645) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] [instance: a816f335-7f2e-4121-9667-237b22349724] swap_volume: Updating volume 56427b94-10c4-4a08-bc13-0d2a081390c8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "VEfAbcXZ", "auth_password": "MCmrdc6wUbQIVG", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "317500b2-0855-4b5d-8697-2df652366e5d"}, "status": "reserved", "instance": "a816f335-7f2e-4121-9667-237b22349724", "attached_at": "", "detached_at": "", "volume_id": "317500b2-0855-4b5d-8697-2df652366e5d", "serial": "317500b2-0855-4b5d-8697-2df652366e5d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '317500b2-0855-4b5d-8697-2df652366e5d', 'no_device': None, 'attachment_id': '7dcea5ff-5cf1-44b9-8bb6-69c638b9505c'} {{(pid=70645) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1d13001f-823d-4e53-94d7-0efac36a8892 tempest-TestVolumeSwap-757425443 tempest-TestVolumeSwap-757425443-project-admin] Lock "a816f335-7f2e-4121-9667-237b22349724" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.490s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210538.8915086, 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:55:38 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] VM Resumed (Lifecycle Event)
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:55:38 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Instance spawned successfully.
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:55:38 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:55:38 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210538.8953276, 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:55:38 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] VM Started (Lifecycle Event)
Jul 24 14:55:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:55:39 user nova-compute[70645]: INFO nova.compute.manager [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Took 5.60 seconds to spawn the instance on the hypervisor.
Jul 24 14:55:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-feaa8e85-519d-48b4-8c39-446ecc536397 req-94e55a43-95c4-45b2-9350-cc27b7c240d5 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-feaa8e85-519d-48b4-8c39-446ecc536397 req-94e55a43-95c4-45b2-9350-cc27b7c240d5 service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-feaa8e85-519d-48b4-8c39-446ecc536397 req-94e55a43-95c4-45b2-9350-cc27b7c240d5 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-feaa8e85-519d-48b4-8c39-446ecc536397 req-94e55a43-95c4-45b2-9350-cc27b7c240d5 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-feaa8e85-519d-48b4-8c39-446ecc536397 req-94e55a43-95c4-45b2-9350-cc27b7c240d5 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:39 user nova-compute[70645]: WARNING nova.compute.manager [req-feaa8e85-519d-48b4-8c39-446ecc536397 req-94e55a43-95c4-45b2-9350-cc27b7c240d5 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received unexpected event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with vm_state building and task_state spawning.
Jul 24 14:55:39 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:55:39 user nova-compute[70645]: INFO nova.compute.manager [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Took 20.30 seconds to build instance.
Jul 24 14:55:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-928065a9-cfb9-4984-a6eb-eb7c699220e6 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.428s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:39 user nova-compute[70645]: INFO nova.compute.manager [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Detaching volume 317500b2-0855-4b5d-8697-2df652366e5d
Jul 24 14:55:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:39 user nova-compute[70645]: INFO nova.virt.block_device [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Attempting to driver detach volume 317500b2-0855-4b5d-8697-2df652366e5d from mountpoint /dev/vdb
Jul 24 14:55:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Attempting to detach device vdb from instance a816f335-7f2e-4121-9667-237b22349724 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 14:55:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 14:55:39 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:39 user nova-compute[70645]:   <source dev="/dev/sdj"/>
Jul 24 14:55:39 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:55:39 user nova-compute[70645]:   <serial>317500b2-0855-4b5d-8697-2df652366e5d</serial>
Jul 24 14:55:39 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 14:55:39 user nova-compute[70645]: </disk>
Jul 24 14:55:39 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:55:39 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Successfully detached device vdb from instance a816f335-7f2e-4121-9667-237b22349724 from the persistent domain config.
Jul 24 14:55:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a816f335-7f2e-4121-9667-237b22349724 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 14:55:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 14:55:39 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:55:39 user nova-compute[70645]:   <source dev="/dev/sdj"/>
Jul 24 14:55:39 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:55:39 user nova-compute[70645]:   <serial>317500b2-0855-4b5d-8697-2df652366e5d</serial>
Jul 24 14:55:39 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 14:55:39 user nova-compute[70645]: </disk>
Jul 24 14:55:39 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690210540.3902245, a816f335-7f2e-4121-9667-237b22349724 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a816f335-7f2e-4121-9667-237b22349724 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 14:55:40 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Successfully detached device vdb from instance a816f335-7f2e-4121-9667-237b22349724 from the live domain config.
Jul 24 14:55:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEfAbcXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '317500b2-0855-4b5d-8697-2df652366e5d'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:55:40 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[21490c1a-df82-4c41-854d-4223c2d36e2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d9abab-f7ac-4d88-a459-0fb18d1ccd70]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:40 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:55:40 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:55:40 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbaa1ccbac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d'): ({'sdj'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Removing single pathed devices sdj {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a405d6-a6bc-45fc-8e18-c75e8e181425]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a71b0b2-68c9-4dfe-9763-95b568ddef54]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Flushing IO for device /dev/sdj {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[478d3f51-46e0-4ced-9d0c-1213be38a121]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf5f65-4dea-4466-bee7-46eb8280ed2a]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] SCSI volumes sdj have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec843097-a346-4dfd-bf56-c360d521d659]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8a17f3-4d14-4057-9c91-9b67317002f4]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260]
Jul 24 14:55:40 user nova-compute[70645]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d, portal: 172.16.0.220,3260] successful.
Jul 24 14:55:40 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317500b2-0855-4b5d-8697-2df652366e5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca3ea21-7619-4846-9d3c-f218e82db231]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] <== disconnect_volume: return (320ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:55:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:55:41 user nova-compute[70645]: DEBUG nova.objects.instance [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lazy-loading 'flavor' on Instance uuid a816f335-7f2e-4121-9667-237b22349724 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-632c5282-d6af-4da2-bec2-ec1db51de001 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.667s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:55:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:55:42 user nova-compute[70645]: INFO nova.compute.claims [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Claim successful on node user
Jul 24 14:55:42 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:55:42 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:55:43 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.policy [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01c8ead2665a44c8a24dd89ee3b18a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7fb98af2b84c51a448d39d957f5f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:55:43 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Creating image(s)
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "/opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "/opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "/opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.163s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.128s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk 1073741824" returned: 0 in 0.048s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Successfully created port: 3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Cannot resize image /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'migration_context' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Ensure instance console log exists: /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Successfully updated port: 3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquired lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.compute.manager [req-ee9d4ea5-dcb5-438c-a7df-7f0974373385 req-9b595ca5-ea01-42cc-bea9-1ddcf34e4304 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-changed-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.compute.manager [req-ee9d4ea5-dcb5-438c-a7df-7f0974373385 req-9b595ca5-ea01-42cc-bea9-1ddcf34e4304 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Refreshing instance network info cache due to event network-changed-3a56f8d6-1f50-46b0-949f-a64d933dd392. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ee9d4ea5-dcb5-438c-a7df-7f0974373385 req-9b595ca5-ea01-42cc-bea9-1ddcf34e4304 service nova] Acquiring lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating instance_info_cache with network_info: [{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Releasing lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance network_info: |[{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ee9d4ea5-dcb5-438c-a7df-7f0974373385 req-9b595ca5-ea01-42cc-bea9-1ddcf34e4304 service nova] Acquired lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.network.neutron [req-ee9d4ea5-dcb5-438c-a7df-7f0974373385 req-9b595ca5-ea01-42cc-bea9-1ddcf34e4304 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Refreshing network info cache for port 3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Start _get_guest_xml network_info=[{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:55:44 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:55:44 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:55:44 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887972996',display_name='tempest-ServerActionsTestOtherB-server-1887972996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887972996',id=14,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMleqYhBZCEEjJJsaMEuckPLdRSggssXX58+jSUDWV4RWgJi1aCvZ7GKXmFcDgd20RUebLSGWW0+tvwfBRktv2c+QmVz9Ve3ikoCtp5+5Q7Q8T6xY4TIWukXrdzPtz1wFA==',key_name='tempest-keypair-1765023642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a7fb98af2b84c51a448d39d957f5f6a',ramdisk_id='',reservation_id='r-fex15wu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-589948319',owner_user_name='tempest-ServerActionsTestOtherB-589948319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01c8ead2665a44c8a24dd89ee3b18a72',uuid=460ae655-2955-4a45-9b12-2a3ddd9f448b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converting VIF {"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'pci_devices' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:55:45 user nova-compute[70645]:   <uuid>460ae655-2955-4a45-9b12-2a3ddd9f448b</uuid>
Jul 24 14:55:45 user nova-compute[70645]:   <name>instance-0000000e</name>
Jul 24 14:55:45 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:55:45 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:55:45 user nova-compute[70645]:   <metadata>
Jul 24 14:55:45 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:55:45 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:55:45 user nova-compute[70645]:       <nova:name>tempest-ServerActionsTestOtherB-server-1887972996</nova:name>
Jul 24 14:55:45 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:55:44</nova:creationTime>
Jul 24 14:55:45 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:55:45 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:55:45 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:55:45 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:55:45 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:55:45 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:55:45 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:55:45 user nova-compute[70645]:       <nova:owner>
Jul 24 14:55:45 user nova-compute[70645]:         <nova:user uuid="01c8ead2665a44c8a24dd89ee3b18a72">tempest-ServerActionsTestOtherB-589948319-project-member</nova:user>
Jul 24 14:55:45 user nova-compute[70645]:         <nova:project uuid="6a7fb98af2b84c51a448d39d957f5f6a">tempest-ServerActionsTestOtherB-589948319</nova:project>
Jul 24 14:55:45 user nova-compute[70645]:       </nova:owner>
Jul 24 14:55:45 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:55:45 user nova-compute[70645]:       <nova:ports>
Jul 24 14:55:45 user nova-compute[70645]:         <nova:port uuid="3a56f8d6-1f50-46b0-949f-a64d933dd392">
Jul 24 14:55:45 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 14:55:45 user nova-compute[70645]:         </nova:port>
Jul 24 14:55:45 user nova-compute[70645]:       </nova:ports>
Jul 24 14:55:45 user nova-compute[70645]:     </nova:instance>
Jul 24 14:55:45 user nova-compute[70645]:   </metadata>
Jul 24 14:55:45 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:55:45 user nova-compute[70645]:     <system>
Jul 24 14:55:45 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:55:45 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:55:45 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:55:45 user nova-compute[70645]:       <entry name="serial">460ae655-2955-4a45-9b12-2a3ddd9f448b</entry>
Jul 24 14:55:45 user nova-compute[70645]:       <entry name="uuid">460ae655-2955-4a45-9b12-2a3ddd9f448b</entry>
Jul 24 14:55:45 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:55:45 user nova-compute[70645]:     </system>
Jul 24 14:55:45 user nova-compute[70645]:   </sysinfo>
Jul 24 14:55:45 user nova-compute[70645]:   <os>
Jul 24 14:55:45 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:55:45 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:55:45 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:55:45 user nova-compute[70645]:   </os>
Jul 24 14:55:45 user nova-compute[70645]:   <features>
Jul 24 14:55:45 user nova-compute[70645]:     <acpi/>
Jul 24 14:55:45 user nova-compute[70645]:     <apic/>
Jul 24 14:55:45 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:55:45 user nova-compute[70645]:   </features>
Jul 24 14:55:45 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:55:45 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:55:45 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:55:45 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:55:45 user nova-compute[70645]:   </clock>
Jul 24 14:55:45 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:55:45 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:55:45 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:55:45 user nova-compute[70645]:   </cpu>
Jul 24 14:55:45 user nova-compute[70645]:   <devices>
Jul 24 14:55:45 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:55:45 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:55:45 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk"/>
Jul 24 14:55:45 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:55:45 user nova-compute[70645]:     </disk>
Jul 24 14:55:45 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:55:45 user nova-compute[70645]:       <mac address="fa:16:3e:46:ef:9d"/>
Jul 24 14:55:45 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:55:45 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:55:45 user nova-compute[70645]:       <target dev="tap3a56f8d6-1f"/>
Jul 24 14:55:45 user nova-compute[70645]:     </interface>
Jul 24 14:55:45 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:55:45 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/console.log" append="off"/>
Jul 24 14:55:45 user nova-compute[70645]:     </serial>
Jul 24 14:55:45 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:55:45 user nova-compute[70645]:     <video>
Jul 24 14:55:45 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:55:45 user nova-compute[70645]:     </video>
Jul 24 14:55:45 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:55:45 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:55:45 user nova-compute[70645]:     </rng>
Jul 24 14:55:45 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:55:45 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:55:45 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:55:45 user nova-compute[70645]:     </memballoon>
Jul 24 14:55:45 user nova-compute[70645]:   </devices>
Jul 24 14:55:45 user nova-compute[70645]: </domain>
Jul 24 14:55:45 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887972996',display_name='tempest-ServerActionsTestOtherB-server-1887972996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887972996',id=14,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMleqYhBZCEEjJJsaMEuckPLdRSggssXX58+jSUDWV4RWgJi1aCvZ7GKXmFcDgd20RUebLSGWW0+tvwfBRktv2c+QmVz9Ve3ikoCtp5+5Q7Q8T6xY4TIWukXrdzPtz1wFA==',key_name='tempest-keypair-1765023642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a7fb98af2b84c51a448d39d957f5f6a',ramdisk_id='',reservation_id='r-fex15wu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-589948319',owner_user_name='tempest-ServerActionsTestOtherB-589948319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01c8ead2665a44c8a24dd89ee3b18a72',uuid=460ae655-2955-4a45-9b12-2a3ddd9f448b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converting VIF {"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG os_vif [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a56f8d6-1f, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a56f8d6-1f, col_values=(('external_ids', {'iface-id': '3a56f8d6-1f50-46b0-949f-a64d933dd392', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:ef:9d', 'vm-uuid': '460ae655-2955-4a45-9b12-2a3ddd9f448b'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:45 user nova-compute[70645]: INFO os_vif [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f')
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] No VIF found with MAC fa:16:3e:46:ef:9d, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-ee9d4ea5-dcb5-438c-a7df-7f0974373385 req-9b595ca5-ea01-42cc-bea9-1ddcf34e4304 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updated VIF entry in instance network info cache for port 3a56f8d6-1f50-46b0-949f-a64d933dd392. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-ee9d4ea5-dcb5-438c-a7df-7f0974373385 req-9b595ca5-ea01-42cc-bea9-1ddcf34e4304 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating instance_info_cache with network_info: [{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ee9d4ea5-dcb5-438c-a7df-7f0974373385 req-9b595ca5-ea01-42cc-bea9-1ddcf34e4304 service nova] Releasing lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:55:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:46 user nova-compute[70645]: DEBUG nova.compute.manager [req-c0b2f89b-ed3c-48a2-8b76-364b109819cb req-0ca8b99c-08fc-409f-9dce-0c758377cba9 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c0b2f89b-ed3c-48a2-8b76-364b109819cb req-0ca8b99c-08fc-409f-9dce-0c758377cba9 service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c0b2f89b-ed3c-48a2-8b76-364b109819cb req-0ca8b99c-08fc-409f-9dce-0c758377cba9 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c0b2f89b-ed3c-48a2-8b76-364b109819cb req-0ca8b99c-08fc-409f-9dce-0c758377cba9 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:46 user nova-compute[70645]: DEBUG nova.compute.manager [req-c0b2f89b-ed3c-48a2-8b76-364b109819cb req-0ca8b99c-08fc-409f-9dce-0c758377cba9 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:46 user nova-compute[70645]: WARNING nova.compute.manager [req-c0b2f89b-ed3c-48a2-8b76-364b109819cb req-0ca8b99c-08fc-409f-9dce-0c758377cba9 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received unexpected event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with vm_state building and task_state spawning.
Jul 24 14:55:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210548.495446, 460ae655-2955-4a45-9b12-2a3ddd9f448b => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:55:48 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] VM Resumed (Lifecycle Event)
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:55:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance spawned successfully.
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:55:48 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210548.49662, 460ae655-2955-4a45-9b12-2a3ddd9f448b => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:55:48 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] VM Started (Lifecycle Event)
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:55:48 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:55:48 user nova-compute[70645]: INFO nova.compute.manager [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Took 5.40 seconds to spawn the instance on the hypervisor.
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:48 user nova-compute[70645]: INFO nova.compute.manager [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Took 6.09 seconds to build instance.
Jul 24 14:55:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4af31e1c-fa80-4282-8f45-31f0f1caa702 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.178s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-0dc671b5-8cfb-44cf-aa92-cec37dd2c5f1 req-50412c78-d4d4-492a-809f-05a2565a1e52 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0dc671b5-8cfb-44cf-aa92-cec37dd2c5f1 req-50412c78-d4d4-492a-809f-05a2565a1e52 service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0dc671b5-8cfb-44cf-aa92-cec37dd2c5f1 req-50412c78-d4d4-492a-809f-05a2565a1e52 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0dc671b5-8cfb-44cf-aa92-cec37dd2c5f1 req-50412c78-d4d4-492a-809f-05a2565a1e52 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-0dc671b5-8cfb-44cf-aa92-cec37dd2c5f1 req-50412c78-d4d4-492a-809f-05a2565a1e52 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:48 user nova-compute[70645]: WARNING nova.compute.manager [req-0dc671b5-8cfb-44cf-aa92-cec37dd2c5f1 req-50412c78-d4d4-492a-809f-05a2565a1e52 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received unexpected event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with vm_state active and task_state None.
Jul 24 14:55:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:55:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:55:53 user nova-compute[70645]: INFO nova.compute.claims [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Claim successful on node user
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:55:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.policy [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad0dc6a130114d50b702de26be47c3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a447bf5ed203471ab178b4433a1c40ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:55:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Creating image(s)
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "/opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "/opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "/opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk 1073741824" returned: 0 in 0.057s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Successfully created port: 77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Cannot resize image /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lazy-loading 'migration_context' on Instance uuid dae4da41-53a6-44a5-bd36-90b9f6bb828d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Ensure instance console log exists: /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Successfully updated port: 77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "refresh_cache-dae4da41-53a6-44a5-bd36-90b9f6bb828d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquired lock "refresh_cache-dae4da41-53a6-44a5-bd36-90b9f6bb828d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-feed431b-c22b-4e6c-bb6b-6e08ac54ae20 req-faca1450-b0b2-42e8-8409-27d4639f9de9 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Received event network-changed-77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-feed431b-c22b-4e6c-bb6b-6e08ac54ae20 req-faca1450-b0b2-42e8-8409-27d4639f9de9 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Refreshing instance network info cache due to event network-changed-77d93a4d-05e3-43c0-9cda-084b24a997f5. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-feed431b-c22b-4e6c-bb6b-6e08ac54ae20 req-faca1450-b0b2-42e8-8409-27d4639f9de9 service nova] Acquiring lock "refresh_cache-dae4da41-53a6-44a5-bd36-90b9f6bb828d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Updating instance_info_cache with network_info: [{"id": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "address": "fa:16:3e:07:59:53", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d93a4d-05", "ovs_interfaceid": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Releasing lock "refresh_cache-dae4da41-53a6-44a5-bd36-90b9f6bb828d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Instance network_info: |[{"id": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "address": "fa:16:3e:07:59:53", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d93a4d-05", "ovs_interfaceid": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-feed431b-c22b-4e6c-bb6b-6e08ac54ae20 req-faca1450-b0b2-42e8-8409-27d4639f9de9 service nova] Acquired lock "refresh_cache-dae4da41-53a6-44a5-bd36-90b9f6bb828d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-feed431b-c22b-4e6c-bb6b-6e08ac54ae20 req-faca1450-b0b2-42e8-8409-27d4639f9de9 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Refreshing network info cache for port 77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Start _get_guest_xml network_info=[{"id": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "address": "fa:16:3e:07:59:53", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d93a4d-05", "ovs_interfaceid": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:55:55 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:55:55 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:55:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1641424777',display_name='tempest-VolumesAdminNegativeTest-server-1641424777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1641424777',id=15,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a447bf5ed203471ab178b4433a1c40ce',ramdisk_id='',reservation_id='r-4d0kahuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1454211316',owner_user_name='tempest-VolumesAdminNegativeTest-1454211316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:55:54Z,user_data=None,user_id='ad0dc6a130114d50b702de26be47c3a0',uuid=dae4da41-53a6-44a5-bd36-90b9f6bb828d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "address": "fa:16:3e:07:59:53", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d93a4d-05", "ovs_interfaceid": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converting VIF {"id": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "address": "fa:16:3e:07:59:53", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d93a4d-05", "ovs_interfaceid": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:59:53,bridge_name='br-int',has_traffic_filtering=True,id=77d93a4d-05e3-43c0-9cda-084b24a997f5,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d93a4d-05') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lazy-loading 'pci_devices' on Instance uuid dae4da41-53a6-44a5-bd36-90b9f6bb828d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:55:56 user nova-compute[70645]:   <uuid>dae4da41-53a6-44a5-bd36-90b9f6bb828d</uuid>
Jul 24 14:55:56 user nova-compute[70645]:   <name>instance-0000000f</name>
Jul 24 14:55:56 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:55:56 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:55:56 user nova-compute[70645]:   <metadata>
Jul 24 14:55:56 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:55:56 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:55:56 user nova-compute[70645]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1641424777</nova:name>
Jul 24 14:55:56 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:55:55</nova:creationTime>
Jul 24 14:55:56 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:55:56 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:55:56 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:55:56 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:55:56 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:55:56 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:55:56 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:55:56 user nova-compute[70645]:       <nova:owner>
Jul 24 14:55:56 user nova-compute[70645]:         <nova:user uuid="ad0dc6a130114d50b702de26be47c3a0">tempest-VolumesAdminNegativeTest-1454211316-project-member</nova:user>
Jul 24 14:55:56 user nova-compute[70645]:         <nova:project uuid="a447bf5ed203471ab178b4433a1c40ce">tempest-VolumesAdminNegativeTest-1454211316</nova:project>
Jul 24 14:55:56 user nova-compute[70645]:       </nova:owner>
Jul 24 14:55:56 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:55:56 user nova-compute[70645]:       <nova:ports>
Jul 24 14:55:56 user nova-compute[70645]:         <nova:port uuid="77d93a4d-05e3-43c0-9cda-084b24a997f5">
Jul 24 14:55:56 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 14:55:56 user nova-compute[70645]:         </nova:port>
Jul 24 14:55:56 user nova-compute[70645]:       </nova:ports>
Jul 24 14:55:56 user nova-compute[70645]:     </nova:instance>
Jul 24 14:55:56 user nova-compute[70645]:   </metadata>
Jul 24 14:55:56 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:55:56 user nova-compute[70645]:     <system>
Jul 24 14:55:56 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:55:56 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:55:56 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:55:56 user nova-compute[70645]:       <entry name="serial">dae4da41-53a6-44a5-bd36-90b9f6bb828d</entry>
Jul 24 14:55:56 user nova-compute[70645]:       <entry name="uuid">dae4da41-53a6-44a5-bd36-90b9f6bb828d</entry>
Jul 24 14:55:56 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:55:56 user nova-compute[70645]:     </system>
Jul 24 14:55:56 user nova-compute[70645]:   </sysinfo>
Jul 24 14:55:56 user nova-compute[70645]:   <os>
Jul 24 14:55:56 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:55:56 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:55:56 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:55:56 user nova-compute[70645]:   </os>
Jul 24 14:55:56 user nova-compute[70645]:   <features>
Jul 24 14:55:56 user nova-compute[70645]:     <acpi/>
Jul 24 14:55:56 user nova-compute[70645]:     <apic/>
Jul 24 14:55:56 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:55:56 user nova-compute[70645]:   </features>
Jul 24 14:55:56 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:55:56 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:55:56 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:55:56 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:55:56 user nova-compute[70645]:   </clock>
Jul 24 14:55:56 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:55:56 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:55:56 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:55:56 user nova-compute[70645]:   </cpu>
Jul 24 14:55:56 user nova-compute[70645]:   <devices>
Jul 24 14:55:56 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:55:56 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:55:56 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk"/>
Jul 24 14:55:56 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:55:56 user nova-compute[70645]:     </disk>
Jul 24 14:55:56 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:55:56 user nova-compute[70645]:       <mac address="fa:16:3e:07:59:53"/>
Jul 24 14:55:56 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:55:56 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:55:56 user nova-compute[70645]:       <target dev="tap77d93a4d-05"/>
Jul 24 14:55:56 user nova-compute[70645]:     </interface>
Jul 24 14:55:56 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:55:56 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/console.log" append="off"/>
Jul 24 14:55:56 user nova-compute[70645]:     </serial>
Jul 24 14:55:56 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:55:56 user nova-compute[70645]:     <video>
Jul 24 14:55:56 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:55:56 user nova-compute[70645]:     </video>
Jul 24 14:55:56 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:55:56 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:55:56 user nova-compute[70645]:     </rng>
Jul 24 14:55:56 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:55:56 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:55:56 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:55:56 user nova-compute[70645]:     </memballoon>
Jul 24 14:55:56 user nova-compute[70645]:   </devices>
Jul 24 14:55:56 user nova-compute[70645]: </domain>
Jul 24 14:55:56 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1641424777',display_name='tempest-VolumesAdminNegativeTest-server-1641424777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1641424777',id=15,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a447bf5ed203471ab178b4433a1c40ce',ramdisk_id='',reservation_id='r-4d0kahuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1454211316',owner_user_name='tempest-VolumesAdminNegativeTest-1454211316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:55:54Z,user_data=None,user_id='ad0dc6a130114d50b702de26be47c3a0',uuid=dae4da41-53a6-44a5-bd36-90b9f6bb828d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "address": "fa:16:3e:07:59:53", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d93a4d-05", "ovs_interfaceid": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converting VIF {"id": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "address": "fa:16:3e:07:59:53", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d93a4d-05", "ovs_interfaceid": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:59:53,bridge_name='br-int',has_traffic_filtering=True,id=77d93a4d-05e3-43c0-9cda-084b24a997f5,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d93a4d-05') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG os_vif [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:59:53,bridge_name='br-int',has_traffic_filtering=True,id=77d93a4d-05e3-43c0-9cda-084b24a997f5,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d93a4d-05') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77d93a4d-05, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77d93a4d-05, col_values=(('external_ids', {'iface-id': '77d93a4d-05e3-43c0-9cda-084b24a997f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:59:53', 'vm-uuid': 'dae4da41-53a6-44a5-bd36-90b9f6bb828d'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:56 user nova-compute[70645]: INFO os_vif [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:59:53,bridge_name='br-int',has_traffic_filtering=True,id=77d93a4d-05e3-43c0-9cda-084b24a997f5,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d93a4d-05')
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] No VIF found with MAC fa:16:3e:07:59:53, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.network.neutron [req-feed431b-c22b-4e6c-bb6b-6e08ac54ae20 req-faca1450-b0b2-42e8-8409-27d4639f9de9 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Updated VIF entry in instance network info cache for port 77d93a4d-05e3-43c0-9cda-084b24a997f5. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG nova.network.neutron [req-feed431b-c22b-4e6c-bb6b-6e08ac54ae20 req-faca1450-b0b2-42e8-8409-27d4639f9de9 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Updating instance_info_cache with network_info: [{"id": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "address": "fa:16:3e:07:59:53", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d93a4d-05", "ovs_interfaceid": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:55:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-feed431b-c22b-4e6c-bb6b-6e08ac54ae20 req-faca1450-b0b2-42e8-8409-27d4639f9de9 service nova] Releasing lock "refresh_cache-dae4da41-53a6-44a5-bd36-90b9f6bb828d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:55:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa6a5c28-eb48-4644-b1f2-aa9c1971d97d req-07ddf3a0-b30d-4b7a-b4f0-1b6bda573fce service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Received event network-vif-plugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa6a5c28-eb48-4644-b1f2-aa9c1971d97d req-07ddf3a0-b30d-4b7a-b4f0-1b6bda573fce service nova] Acquiring lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa6a5c28-eb48-4644-b1f2-aa9c1971d97d req-07ddf3a0-b30d-4b7a-b4f0-1b6bda573fce service nova] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fa6a5c28-eb48-4644-b1f2-aa9c1971d97d req-07ddf3a0-b30d-4b7a-b4f0-1b6bda573fce service nova] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-fa6a5c28-eb48-4644-b1f2-aa9c1971d97d req-07ddf3a0-b30d-4b7a-b4f0-1b6bda573fce service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] No waiting events found dispatching network-vif-plugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:57 user nova-compute[70645]: WARNING nova.compute.manager [req-fa6a5c28-eb48-4644-b1f2-aa9c1971d97d req-07ddf3a0-b30d-4b7a-b4f0-1b6bda573fce service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Received unexpected event network-vif-plugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 for instance with vm_state building and task_state spawning.
Jul 24 14:55:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210559.5436213, dae4da41-53a6-44a5-bd36-90b9f6bb828d => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:55:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] VM Resumed (Lifecycle Event)
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:55:59 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Instance spawned successfully.
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:55:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210559.545554, dae4da41-53a6-44a5-bd36-90b9f6bb828d => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:55:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] VM Started (Lifecycle Event)
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:55:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:55:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Took 5.38 seconds to spawn the instance on the hypervisor.
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-bad0a1f4-2766-4e56-a7ca-442b9d0b04e0 req-9862d094-b0b1-49aa-984c-4a265d560634 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Received event network-vif-plugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bad0a1f4-2766-4e56-a7ca-442b9d0b04e0 req-9862d094-b0b1-49aa-984c-4a265d560634 service nova] Acquiring lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bad0a1f4-2766-4e56-a7ca-442b9d0b04e0 req-9862d094-b0b1-49aa-984c-4a265d560634 service nova] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bad0a1f4-2766-4e56-a7ca-442b9d0b04e0 req-9862d094-b0b1-49aa-984c-4a265d560634 service nova] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:55:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-bad0a1f4-2766-4e56-a7ca-442b9d0b04e0 req-9862d094-b0b1-49aa-984c-4a265d560634 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] No waiting events found dispatching network-vif-plugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:55:59 user nova-compute[70645]: WARNING nova.compute.manager [req-bad0a1f4-2766-4e56-a7ca-442b9d0b04e0 req-9862d094-b0b1-49aa-984c-4a265d560634 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Received unexpected event network-vif-plugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 for instance with vm_state building and task_state spawning.
Jul 24 14:55:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Took 6.18 seconds to build instance.
Jul 24 14:55:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4fdee870-006e-45c2-bd91-c4de2328b73b tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.380s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:05 user nova-compute[70645]: INFO nova.compute.manager [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Terminating instance
Jul 24 14:56:05 user nova-compute[70645]: DEBUG nova.compute.manager [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-e7e99c67-28bc-40ab-a089-cf6d3d7b4102 req-944a1446-7caf-454b-a36c-d0d838723765 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-vif-unplugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e7e99c67-28bc-40ab-a089-cf6d3d7b4102 req-944a1446-7caf-454b-a36c-d0d838723765 service nova] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e7e99c67-28bc-40ab-a089-cf6d3d7b4102 req-944a1446-7caf-454b-a36c-d0d838723765 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e7e99c67-28bc-40ab-a089-cf6d3d7b4102 req-944a1446-7caf-454b-a36c-d0d838723765 service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-e7e99c67-28bc-40ab-a089-cf6d3d7b4102 req-944a1446-7caf-454b-a36c-d0d838723765 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] No waiting events found dispatching network-vif-unplugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-e7e99c67-28bc-40ab-a089-cf6d3d7b4102 req-944a1446-7caf-454b-a36c-d0d838723765 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-vif-unplugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Instance destroyed successfully.
Jul 24 14:56:05 user nova-compute[70645]: DEBUG nova.objects.instance [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lazy-loading 'resources' on Instance uuid 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-896493417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-896493417',id=8,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOC+pbtS3b10zgGPN8jzEAGTj3Lutj6NjqD/u3q2th61GdXcNYKMiu+ZkghxLk9jByTpKK5pKCNa5736mrWQiHDLOInWyMhYDKqT7SxK/aJuuMMC5WiwiwkOIdnj15Mqg==',key_name='tempest-keypair-1737242635',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7e96ad4dba143709ad8715dea63bf23',ramdisk_id='',reservation_id='r-wle60jho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-813130247',owner_user_name='tempest-TaggedAttachmentsTest-813130247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28e6065f28da456b888cc801f7561b85',uuid=5f355cfc-9d1b-4f2b-936b-e28a65bd99e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converting VIF {"id": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "address": "fa:16:3e:32:d0:25", "network": {"id": "052eebd2-fa35-4f82-a9d0-1261feeffd4f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-112686558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e96ad4dba143709ad8715dea63bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe5f4a4-6a", "ovs_interfaceid": "bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:d0:25,bridge_name='br-int',has_traffic_filtering=True,id=bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1,network=Network(052eebd2-fa35-4f82-a9d0-1261feeffd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe5f4a4-6a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG os_vif [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d0:25,bridge_name='br-int',has_traffic_filtering=True,id=bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1,network=Network(052eebd2-fa35-4f82-a9d0-1261feeffd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe5f4a4-6a') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfe5f4a4-6a, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:05 user nova-compute[70645]: INFO os_vif [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d0:25,bridge_name='br-int',has_traffic_filtering=True,id=bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1,network=Network(052eebd2-fa35-4f82-a9d0-1261feeffd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe5f4a4-6a')
Jul 24 14:56:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Deleting instance files /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1_del
Jul 24 14:56:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Deletion of /opt/stack/data/nova/instances/5f355cfc-9d1b-4f2b-936b-e28a65bd99e1_del complete
Jul 24 14:56:06 user nova-compute[70645]: INFO nova.compute.manager [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 24 14:56:06 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:56:06 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:56:06 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:56:06 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:06 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Took 0.89 seconds to deallocate network for instance.
Jul 24 14:56:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-846b71ff-4bc0-4dd6-a386-5d62cd0415c4 req-c7e92096-c67f-4b4e-8fa4-e030a4d56924 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-vif-deleted-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:06 user nova-compute[70645]: INFO nova.compute.manager [req-846b71ff-4bc0-4dd6-a386-5d62cd0415c4 req-c7e92096-c67f-4b4e-8fa4-e030a4d56924 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Neutron deleted interface bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1; detaching it from the instance and deleting it from the info cache
Jul 24 14:56:06 user nova-compute[70645]: DEBUG nova.network.neutron [req-846b71ff-4bc0-4dd6-a386-5d62cd0415c4 req-c7e92096-c67f-4b4e-8fa4-e030a4d56924 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-846b71ff-4bc0-4dd6-a386-5d62cd0415c4 req-c7e92096-c67f-4b4e-8fa4-e030a4d56924 service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Detach interface failed, port_id=bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1, reason: Instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 14:56:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:07 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:56:07 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:56:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:07 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Deleted allocations for instance 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1
Jul 24 14:56:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-129e84ff-9c49-41b0-95bf-613735c218e7 req-c562c67a-fcd0-41bd-bdd9-6a1d17674fdf service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received event network-vif-plugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-129e84ff-9c49-41b0-95bf-613735c218e7 req-c562c67a-fcd0-41bd-bdd9-6a1d17674fdf service nova] Acquiring lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-129e84ff-9c49-41b0-95bf-613735c218e7 req-c562c67a-fcd0-41bd-bdd9-6a1d17674fdf service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-129e84ff-9c49-41b0-95bf-613735c218e7 req-c562c67a-fcd0-41bd-bdd9-6a1d17674fdf service nova] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-129e84ff-9c49-41b0-95bf-613735c218e7 req-c562c67a-fcd0-41bd-bdd9-6a1d17674fdf service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] No waiting events found dispatching network-vif-plugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:07 user nova-compute[70645]: WARNING nova.compute.manager [req-129e84ff-9c49-41b0-95bf-613735c218e7 req-c562c67a-fcd0-41bd-bdd9-6a1d17674fdf service nova] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Received unexpected event network-vif-plugged-bfe5f4a4-6a8e-4fd0-aa3e-ded5ca1fbbc1 for instance with vm_state deleted and task_state None.
Jul 24 14:56:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-841901cb-d629-4927-b46b-e426a0eec745 tempest-TaggedAttachmentsTest-813130247 tempest-TaggedAttachmentsTest-813130247-project-member] Lock "5f355cfc-9d1b-4f2b-936b-e28a65bd99e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.457s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:13 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:56:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 14:56:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:56:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:56:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:14 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:17 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:56:17 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:56:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7259MB free_disk=25.76955795288086GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:56:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 046adfbd-fa5f-45f5-ae62-ddc0f834d450 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance f1a667e2-7992-44e4-9500-fa598493e173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance a816f335-7f2e-4121-9667-237b22349724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance d2c5d524-aade-4229-b12a-f953c25eaa40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 2518724a-a4f8-44e6-8820-1019289e65fc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance dd796d18-9a13-40b8-9f4e-0a9dd93d4149 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance ff0bb392-a296-45a0-a102-f8b0e1c9d41a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 460ae655-2955-4a45-9b12-2a3ddd9f448b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance dae4da41-53a6-44a5-bd36-90b9f6bb828d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:19 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:56:19 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:56:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 14:56:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:56:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:56:19 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 14:56:20 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Updating instance_info_cache with network_info: [{"id": "014795b1-c234-4335-acff-79b1fbab054f", "address": "fa:16:3e:4d:44:3f", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014795b1-c2", "ovs_interfaceid": "014795b1-c234-4335-acff-79b1fbab054f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-f1a667e2-7992-44e4-9500-fa598493e173" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:56:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 14:56:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:56:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:56:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:56:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:56:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:56:20 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210565.9148085, 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:56:20 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] VM Stopped (Lifecycle Event)
Jul 24 14:56:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-28a8cfe1-0e3b-44bb-a65e-449a7fc52233 None None] [instance: 5f355cfc-9d1b-4f2b-936b-e28a65bd99e1] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:56:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:56:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:22 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:56:22 user nova-compute[70645]: INFO nova.compute.claims [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Claim successful on node user
Jul 24 14:56:22 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:56:22 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:56:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:56:23 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:56:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG nova.policy [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43cd7067d09747f9b80cec22154a0e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863d6c0aad845139d04b550254d59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:56:23 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Creating image(s)
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "/opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "/opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "/opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk 1073741824" returned: 0 in 0.053s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.164s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Cannot resize image /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:56:23 user nova-compute[70645]: DEBUG nova.objects.instance [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'migration_context' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:56:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Ensure instance console log exists: /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:56:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Successfully created port: 254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-82a47091-7c94-4b94-baf5-6c1f13cabdc8 req-22431f55-dd9d-4a25-9e17-f1cad78ebf76 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-changed-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-82a47091-7c94-4b94-baf5-6c1f13cabdc8 req-22431f55-dd9d-4a25-9e17-f1cad78ebf76 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing instance network info cache due to event network-changed-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-82a47091-7c94-4b94-baf5-6c1f13cabdc8 req-22431f55-dd9d-4a25-9e17-f1cad78ebf76 service nova] Acquiring lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-82a47091-7c94-4b94-baf5-6c1f13cabdc8 req-22431f55-dd9d-4a25-9e17-f1cad78ebf76 service nova] Acquired lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.network.neutron [req-82a47091-7c94-4b94-baf5-6c1f13cabdc8 req-22431f55-dd9d-4a25-9e17-f1cad78ebf76 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Refreshing network info cache for port 6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Successfully updated port: 254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquired lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-c12de802-8fc3-4dfb-a11c-f110111191fc req-9b5485e8-7594-40ed-8e65-d83365566674 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-changed-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-c12de802-8fc3-4dfb-a11c-f110111191fc req-9b5485e8-7594-40ed-8e65-d83365566674 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Refreshing instance network info cache due to event network-changed-254aef5a-c4f8-473b-a2c0-6db998ebc479. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c12de802-8fc3-4dfb-a11c-f110111191fc req-9b5485e8-7594-40ed-8e65-d83365566674 service nova] Acquiring lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updating instance_info_cache with network_info: [{"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Releasing lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Instance network_info: |[{"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c12de802-8fc3-4dfb-a11c-f110111191fc req-9b5485e8-7594-40ed-8e65-d83365566674 service nova] Acquired lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.network.neutron [req-c12de802-8fc3-4dfb-a11c-f110111191fc req-9b5485e8-7594-40ed-8e65-d83365566674 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Refreshing network info cache for port 254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Start _get_guest_xml network_info=[{"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:56:25 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:56:25 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:56:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1375956069',display_name='tempest-ServerActionsTestOtherA-server-1375956069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1375956069',id=16,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-wu79uln7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:56:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=20469e51-a240-48ea-bdf4-f7a59d129232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.objects.instance [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'pci_devices' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:56:25 user nova-compute[70645]:   <uuid>20469e51-a240-48ea-bdf4-f7a59d129232</uuid>
Jul 24 14:56:25 user nova-compute[70645]:   <name>instance-00000010</name>
Jul 24 14:56:25 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:56:25 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:56:25 user nova-compute[70645]:   <metadata>
Jul 24 14:56:25 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:56:25 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:56:25 user nova-compute[70645]:       <nova:name>tempest-ServerActionsTestOtherA-server-1375956069</nova:name>
Jul 24 14:56:25 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:56:25</nova:creationTime>
Jul 24 14:56:25 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:56:25 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:56:25 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:56:25 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:56:25 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:56:25 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:56:25 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:56:25 user nova-compute[70645]:       <nova:owner>
Jul 24 14:56:25 user nova-compute[70645]:         <nova:user uuid="43cd7067d09747f9b80cec22154a0e93">tempest-ServerActionsTestOtherA-1886739574-project-member</nova:user>
Jul 24 14:56:25 user nova-compute[70645]:         <nova:project uuid="f863d6c0aad845139d04b550254d59e3">tempest-ServerActionsTestOtherA-1886739574</nova:project>
Jul 24 14:56:25 user nova-compute[70645]:       </nova:owner>
Jul 24 14:56:25 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:56:25 user nova-compute[70645]:       <nova:ports>
Jul 24 14:56:25 user nova-compute[70645]:         <nova:port uuid="254aef5a-c4f8-473b-a2c0-6db998ebc479">
Jul 24 14:56:25 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 14:56:25 user nova-compute[70645]:         </nova:port>
Jul 24 14:56:25 user nova-compute[70645]:       </nova:ports>
Jul 24 14:56:25 user nova-compute[70645]:     </nova:instance>
Jul 24 14:56:25 user nova-compute[70645]:   </metadata>
Jul 24 14:56:25 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:56:25 user nova-compute[70645]:     <system>
Jul 24 14:56:25 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:56:25 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:56:25 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:56:25 user nova-compute[70645]:       <entry name="serial">20469e51-a240-48ea-bdf4-f7a59d129232</entry>
Jul 24 14:56:25 user nova-compute[70645]:       <entry name="uuid">20469e51-a240-48ea-bdf4-f7a59d129232</entry>
Jul 24 14:56:25 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:56:25 user nova-compute[70645]:     </system>
Jul 24 14:56:25 user nova-compute[70645]:   </sysinfo>
Jul 24 14:56:25 user nova-compute[70645]:   <os>
Jul 24 14:56:25 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:56:25 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:56:25 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:56:25 user nova-compute[70645]:   </os>
Jul 24 14:56:25 user nova-compute[70645]:   <features>
Jul 24 14:56:25 user nova-compute[70645]:     <acpi/>
Jul 24 14:56:25 user nova-compute[70645]:     <apic/>
Jul 24 14:56:25 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:56:25 user nova-compute[70645]:   </features>
Jul 24 14:56:25 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:56:25 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:56:25 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:56:25 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:56:25 user nova-compute[70645]:   </clock>
Jul 24 14:56:25 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:56:25 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:56:25 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:56:25 user nova-compute[70645]:   </cpu>
Jul 24 14:56:25 user nova-compute[70645]:   <devices>
Jul 24 14:56:25 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:56:25 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:56:25 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk"/>
Jul 24 14:56:25 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:56:25 user nova-compute[70645]:     </disk>
Jul 24 14:56:25 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:56:25 user nova-compute[70645]:       <mac address="fa:16:3e:c0:95:67"/>
Jul 24 14:56:25 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:56:25 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:56:25 user nova-compute[70645]:       <target dev="tap254aef5a-c4"/>
Jul 24 14:56:25 user nova-compute[70645]:     </interface>
Jul 24 14:56:25 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:56:25 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/console.log" append="off"/>
Jul 24 14:56:25 user nova-compute[70645]:     </serial>
Jul 24 14:56:25 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:56:25 user nova-compute[70645]:     <video>
Jul 24 14:56:25 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:56:25 user nova-compute[70645]:     </video>
Jul 24 14:56:25 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:56:25 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:56:25 user nova-compute[70645]:     </rng>
Jul 24 14:56:25 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:56:25 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:56:25 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:56:25 user nova-compute[70645]:     </memballoon>
Jul 24 14:56:25 user nova-compute[70645]:   </devices>
Jul 24 14:56:25 user nova-compute[70645]: </domain>
Jul 24 14:56:25 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:56:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1375956069',display_name='tempest-ServerActionsTestOtherA-server-1375956069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1375956069',id=16,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-wu79uln7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:56:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=20469e51-a240-48ea-bdf4-f7a59d129232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG os_vif [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap254aef5a-c4, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap254aef5a-c4, col_values=(('external_ids', {'iface-id': '254aef5a-c4f8-473b-a2c0-6db998ebc479', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:95:67', 'vm-uuid': '20469e51-a240-48ea-bdf4-f7a59d129232'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:25 user nova-compute[70645]: INFO os_vif [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4')
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:56:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No VIF found with MAC fa:16:3e:c0:95:67, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:56:26 user nova-compute[70645]: DEBUG nova.network.neutron [req-82a47091-7c94-4b94-baf5-6c1f13cabdc8 req-22431f55-dd9d-4a25-9e17-f1cad78ebf76 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updated VIF entry in instance network info cache for port 6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:56:26 user nova-compute[70645]: DEBUG nova.network.neutron [req-82a47091-7c94-4b94-baf5-6c1f13cabdc8 req-22431f55-dd9d-4a25-9e17-f1cad78ebf76 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [{"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-82a47091-7c94-4b94-baf5-6c1f13cabdc8 req-22431f55-dd9d-4a25-9e17-f1cad78ebf76 service nova] Releasing lock "refresh_cache-d2c5d524-aade-4229-b12a-f953c25eaa40" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:56:26 user nova-compute[70645]: DEBUG nova.network.neutron [req-c12de802-8fc3-4dfb-a11c-f110111191fc req-9b5485e8-7594-40ed-8e65-d83365566674 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updated VIF entry in instance network info cache for port 254aef5a-c4f8-473b-a2c0-6db998ebc479. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:56:26 user nova-compute[70645]: DEBUG nova.network.neutron [req-c12de802-8fc3-4dfb-a11c-f110111191fc req-9b5485e8-7594-40ed-8e65-d83365566674 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updating instance_info_cache with network_info: [{"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c12de802-8fc3-4dfb-a11c-f110111191fc req-9b5485e8-7594-40ed-8e65-d83365566674 service nova] Releasing lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG nova.compute.manager [req-bb2f8eb9-a3b0-4521-ac5b-3c526495d2c4 req-4eb38bfa-ff1e-4f83-aa01-811a0cda01bf service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-changed-770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG nova.compute.manager [req-bb2f8eb9-a3b0-4521-ac5b-3c526495d2c4 req-4eb38bfa-ff1e-4f83-aa01-811a0cda01bf service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing instance network info cache due to event network-changed-770c4d59-3054-4195-94cf-facdbc1d5ca7. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb2f8eb9-a3b0-4521-ac5b-3c526495d2c4 req-4eb38bfa-ff1e-4f83-aa01-811a0cda01bf service nova] Acquiring lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb2f8eb9-a3b0-4521-ac5b-3c526495d2c4 req-4eb38bfa-ff1e-4f83-aa01-811a0cda01bf service nova] Acquired lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG nova.network.neutron [req-bb2f8eb9-a3b0-4521-ac5b-3c526495d2c4 req-4eb38bfa-ff1e-4f83-aa01-811a0cda01bf service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Refreshing network info cache for port 770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG nova.network.neutron [req-bb2f8eb9-a3b0-4521-ac5b-3c526495d2c4 req-4eb38bfa-ff1e-4f83-aa01-811a0cda01bf service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updated VIF entry in instance network info cache for port 770c4d59-3054-4195-94cf-facdbc1d5ca7. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG nova.network.neutron [req-bb2f8eb9-a3b0-4521-ac5b-3c526495d2c4 req-4eb38bfa-ff1e-4f83-aa01-811a0cda01bf service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [{"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb2f8eb9-a3b0-4521-ac5b-3c526495d2c4 req-4eb38bfa-ff1e-4f83-aa01-811a0cda01bf service nova] Releasing lock "refresh_cache-2518724a-a4f8-44e6-8820-1019289e65fc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:27 user nova-compute[70645]: INFO nova.compute.manager [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Terminating instance
Jul 24 14:56:27 user nova-compute[70645]: DEBUG nova.compute.manager [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-d653f527-0560-4aef-861a-9439db7c592f req-e7836c47-92d6-45b6-9798-1bc147545672 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d653f527-0560-4aef-861a-9439db7c592f req-e7836c47-92d6-45b6-9798-1bc147545672 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d653f527-0560-4aef-861a-9439db7c592f req-e7836c47-92d6-45b6-9798-1bc147545672 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d653f527-0560-4aef-861a-9439db7c592f req-e7836c47-92d6-45b6-9798-1bc147545672 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-d653f527-0560-4aef-861a-9439db7c592f req-e7836c47-92d6-45b6-9798-1bc147545672 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-unplugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-d653f527-0560-4aef-861a-9439db7c592f req-e7836c47-92d6-45b6-9798-1bc147545672 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1f20be7-34ec-4733-9ac1-45003340b792 req-a4f38e17-a8e2-46f3-a12e-fe597dc619f9 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-d1022a74-2c30-4f91-b050-85f97db29e4d {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f1f20be7-34ec-4733-9ac1-45003340b792 req-a4f38e17-a8e2-46f3-a12e-fe597dc619f9 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f1f20be7-34ec-4733-9ac1-45003340b792 req-a4f38e17-a8e2-46f3-a12e-fe597dc619f9 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f1f20be7-34ec-4733-9ac1-45003340b792 req-a4f38e17-a8e2-46f3-a12e-fe597dc619f9 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1f20be7-34ec-4733-9ac1-45003340b792 req-a4f38e17-a8e2-46f3-a12e-fe597dc619f9 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-unplugged-d1022a74-2c30-4f91-b050-85f97db29e4d {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1f20be7-34ec-4733-9ac1-45003340b792 req-a4f38e17-a8e2-46f3-a12e-fe597dc619f9 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-d1022a74-2c30-4f91-b050-85f97db29e4d for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] No waiting events found dispatching network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:29 user nova-compute[70645]: WARNING nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received unexpected event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 for instance with vm_state building and task_state spawning.
Jul 24 14:56:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] No waiting events found dispatching network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:29 user nova-compute[70645]: WARNING nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received unexpected event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 for instance with vm_state building and task_state spawning.
Jul 24 14:56:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-unplugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:29 user nova-compute[70645]: WARNING nova.compute.manager [req-bdcd5f9a-5be6-4294-a0f1-301b8dd1be7a req-aec36250-6838-4350-8913-4e266068c317 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-a36dd022-bb0f-4848-8fbf-f5c4fb84179c for instance with vm_state active and task_state deleting.
Jul 24 14:56:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "2518724a-a4f8-44e6-8820-1019289e65fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:29 user nova-compute[70645]: INFO nova.compute.manager [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Terminating instance
Jul 24 14:56:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210590.032903, 20469e51-a240-48ea-bdf4-f7a59d129232 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:56:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] VM Resumed (Lifecycle Event)
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:56:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Instance spawned successfully.
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:56:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210590.04965, 20469e51-a240-48ea-bdf4-f7a59d129232 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:56:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] VM Started (Lifecycle Event)
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:56:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Instance destroyed successfully.
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lazy-loading 'resources' on Instance uuid d2c5d524-aade-4229-b12a-f953c25eaa40 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:60:ef,bridge_name='br-int',has_traffic_filtering=True,id=6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f,network=Network(3dd2fe24-cb5b-4370-82bb-75def0166773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9a98e9-ec') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:60:ef,bridge_name='br-int',has_traffic_filtering=True,id=6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f,network=Network(3dd2fe24-cb5b-4370-82bb-75def0166773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9a98e9-ec') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9a98e9-ec, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:30 user nova-compute[70645]: INFO nova.compute.manager [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Took 7.00 seconds to spawn the instance on the hypervisor.
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:30 user nova-compute[70645]: INFO nova.compute.manager [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Took 8.21 seconds to build instance.
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e7fb8ede-511d-4175-b87c-50773822df8c tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.323s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:30 user nova-compute[70645]: INFO nova.compute.manager [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Terminating instance
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: INFO os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:60:ef,bridge_name='br-int',has_traffic_filtering=True,id=6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f,network=Network(3dd2fe24-cb5b-4370-82bb-75def0166773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9a98e9-ec')
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:5e:80,bridge_name='br-int',has_traffic_filtering=True,id=db1a0d8c-19bf-4a1e-b526-7261733683c9,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb1a0d8c-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:5e:80,bridge_name='br-int',has_traffic_filtering=True,id=db1a0d8c-19bf-4a1e-b526-7261733683c9,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb1a0d8c-19') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb1a0d8c-19, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:30 user nova-compute[70645]: WARNING nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f for instance with vm_state active and task_state deleting.
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-unplugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-changed-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Refreshing instance network info cache due to event network-changed-8682dc45-20b4-4e10-aaaf-fa86015cad6b. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Acquiring lock "refresh_cache-dd796d18-9a13-40b8-9f4e-0a9dd93d4149" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Acquired lock "refresh_cache-dd796d18-9a13-40b8-9f4e-0a9dd93d4149" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.network.neutron [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Refreshing network info cache for port 8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-4bf17190-23c0-491a-b417-cae936070220 req-d9adcb03-6a35-4665-91dd-1eea927856bc service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-d1022a74-2c30-4f91-b050-85f97db29e4d {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4bf17190-23c0-491a-b417-cae936070220 req-d9adcb03-6a35-4665-91dd-1eea927856bc service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4bf17190-23c0-491a-b417-cae936070220 req-d9adcb03-6a35-4665-91dd-1eea927856bc service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4bf17190-23c0-491a-b417-cae936070220 req-d9adcb03-6a35-4665-91dd-1eea927856bc service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-4bf17190-23c0-491a-b417-cae936070220 req-d9adcb03-6a35-4665-91dd-1eea927856bc service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-d1022a74-2c30-4f91-b050-85f97db29e4d {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:30 user nova-compute[70645]: WARNING nova.compute.manager [req-4bf17190-23c0-491a-b417-cae936070220 req-d9adcb03-6a35-4665-91dd-1eea927856bc service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-d1022a74-2c30-4f91-b050-85f97db29e4d for instance with vm_state active and task_state deleting.
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: INFO os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:5e:80,bridge_name='br-int',has_traffic_filtering=True,id=db1a0d8c-19bf-4a1e-b526-7261733683c9,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb1a0d8c-19')
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:b0,bridge_name='br-int',has_traffic_filtering=True,id=d1022a74-2c30-4f91-b050-85f97db29e4d,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1022a74-2c') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:b0,bridge_name='br-int',has_traffic_filtering=True,id=d1022a74-2c30-4f91-b050-85f97db29e4d,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1022a74-2c') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1022a74-2c, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: INFO os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:b0,bridge_name='br-int',has_traffic_filtering=True,id=d1022a74-2c30-4f91-b050-85f97db29e4d,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1022a74-2c')
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:bd:fe,bridge_name='br-int',has_traffic_filtering=True,id=a36dd022-bb0f-4848-8fbf-f5c4fb84179c,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36dd022-bb') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:bd:fe,bridge_name='br-int',has_traffic_filtering=True,id=a36dd022-bb0f-4848-8fbf-f5c4fb84179c,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36dd022-bb') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa36dd022-bb, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-unplugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:31 user nova-compute[70645]: WARNING nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd for instance with vm_state active and task_state deleting.
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-unplugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:31 user nova-compute[70645]: WARNING nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 for instance with vm_state active and task_state deleting.
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-unplugged-0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-unplugged-0204e20d-6b04-425c-9141-236a993c3d98 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:31 user nova-compute[70645]: WARNING nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-0204e20d-6b04-425c-9141-236a993c3d98 for instance with vm_state active and task_state deleting.
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-unplugged-be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-51e8ad20-bc9e-40be-8bc6-e14888179837 req-38aeb2a6-bd5f-4eea-9ad3-c699aead42ba service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-be328240-94a4-416a-97d7-e379d07e2e64 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: INFO os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:bd:fe,bridge_name='br-int',has_traffic_filtering=True,id=a36dd022-bb0f-4848-8fbf-f5c4fb84179c,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36dd022-bb')
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "address": "fa:16:3e:37:0e:32", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb07e6e6-49", "ovs_interfaceid": "cb07e6e6-49dd-4330-89b5-6b93af6ed2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=cb07e6e6-49dd-4330-89b5-6b93af6ed2bd,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb07e6e6-49') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=cb07e6e6-49dd-4330-89b5-6b93af6ed2bd,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb07e6e6-49') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb07e6e6-49, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:31 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: a816f335-7f2e-4121-9667-237b22349724] Instance destroyed successfully.
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lazy-loading 'resources' on Instance uuid a816f335-7f2e-4121-9667-237b22349724 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-683612195',display_name='tempest-TestVolumeSwap-server-683612195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-683612195',id=7,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQQ56MbDctncshuOCQq0NQNBIHy0IAktxajEzkJ7Tp7sKS/a7PfwBxREHv6RQ4iZdxloNVc1PsTEYox1dGA5tNPIwRgHeAVS35lRTZ5Q72UE2We3e4zHBaYuF7IW3LWFg==',key_name='tempest-keypair-1085764722',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5e80c8a86e44f3f9d5a84c24675a8e7',ramdisk_id='',reservation_id='r-lbnkuuya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1001337689',owner_user_name='tempest-TestVolumeSwap-1001337689-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8760fdb15c6d4727b2fec40542abe913',uuid=a816f335-7f2e-4121-9667-237b22349724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "address": "fa:16:3e:6a:c6:57", "network": {"id": "757b79f5-32d3-4ac1-8283-6b1ea3b657b1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508181088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e80c8a86e44f3f9d5a84c24675a8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca039191-17", "ovs_interfaceid": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Converting VIF {"id": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "address": "fa:16:3e:6a:c6:57", "network": {"id": "757b79f5-32d3-4ac1-8283-6b1ea3b657b1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508181088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e80c8a86e44f3f9d5a84c24675a8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca039191-17", "ovs_interfaceid": "ca039191-1724-4ec8-ac6f-0264f8d8c7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=ca039191-1724-4ec8-ac6f-0264f8d8c7ff,network=Network(757b79f5-32d3-4ac1-8283-6b1ea3b657b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca039191-17') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG os_vif [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=ca039191-1724-4ec8-ac6f-0264f8d8c7ff,network=Network(757b79f5-32d3-4ac1-8283-6b1ea3b657b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca039191-17') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca039191-17, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:31 user nova-compute[70645]: INFO os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=cb07e6e6-49dd-4330-89b5-6b93af6ed2bd,network=Network(3ba7154c-601d-4010-8553-bd59d0abccf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb07e6e6-49')
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=e2a1f009-ae21-459d-ae50-8b3b6fb3d545,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a1f009-ae') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=e2a1f009-ae21-459d-ae50-8b3b6fb3d545,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a1f009-ae') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2a1f009-ae, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.neutron [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Updated VIF entry in instance network info cache for port 8682dc45-20b4-4e10-aaaf-fa86015cad6b. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.neutron [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Updating instance_info_cache with network_info: [{"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:32 user nova-compute[70645]: INFO os_vif [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=ca039191-1724-4ec8-ac6f-0264f8d8c7ff,network=Network(757b79f5-32d3-4ac1-8283-6b1ea3b657b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca039191-17')
Jul 24 14:56:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Deleting instance files /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724_del
Jul 24 14:56:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Deletion of /opt/stack/data/nova/instances/a816f335-7f2e-4121-9667-237b22349724_del complete
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Releasing lock "refresh_cache-dd796d18-9a13-40b8-9f4e-0a9dd93d4149" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-plugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Acquiring lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] No waiting events found dispatching network-vif-plugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:32 user nova-compute[70645]: WARNING nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received unexpected event network-vif-plugged-db1a0d8c-19bf-4a1e-b526-7261733683c9 for instance with vm_state active and task_state deleting.
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-unplugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8c65073-c30e-4877-bf52-f61841a4c424 req-e87621d0-a223-42ab-93c1-1c47c37b7ed7 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Instance destroyed successfully.
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lazy-loading 'resources' on Instance uuid 2518724a-a4f8-44e6-8820-1019289e65fc {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:32 user nova-compute[70645]: INFO os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=e2a1f009-ae21-459d-ae50-8b3b6fb3d545,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a1f009-ae')
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1568191530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1568191530',id=9,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg3VAmFeIkkA9GGvNdObAwWuCm+3rjQ9/hKrzc3yTeqpzxbHHsf6lI4q6/fYXs5gR+jbh52nAsSrPWW+kxrib//qegwE5/L7NRINTZbQ5Xrg92lXp0/e35BrJetUb2oiw==',key_name='tempest-keypair-2020898512',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374ec2672f3b4469aca169a69c153520',ramdisk_id='',reservation_id='r-28ujxzjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1354903190',owner_user_name='tempest-TaggedBootDevicesTest-1354903190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8623aa5d4d1442bfb72081293363fb83',uuid=d2c5d524-aade-4229-b12a-f953c25eaa40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converting VIF {"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a8,bridge_name='br-int',has_traffic_filtering=True,id=0204e20d-6b04-425c-9141-236a993c3d98,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204e20d-6b') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a8,bridge_name='br-int',has_traffic_filtering=True,id=0204e20d-6b04-425c-9141-236a993c3d98,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204e20d-6b') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=770c4d59-3054-4195-94cf-facdbc1d5ca7,network=Network(d2542284-26af-46bb-b7a7-565471dfe1c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c4d59-30') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=770c4d59-3054-4195-94cf-facdbc1d5ca7,network=Network(d2542284-26af-46bb-b7a7-565471dfe1c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c4d59-30') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0204e20d-6b, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:32 user nova-compute[70645]: INFO nova.compute.manager [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] [instance: a816f335-7f2e-4121-9667-237b22349724] Took 1.71 seconds to destroy the instance on the hypervisor.
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: a816f335-7f2e-4121-9667-237b22349724] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: a816f335-7f2e-4121-9667-237b22349724] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap770c4d59-30, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: INFO os_vif [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a8,bridge_name='br-int',has_traffic_filtering=True,id=0204e20d-6b04-425c-9141-236a993c3d98,network=Network(cfe68c5f-38e0-4c61-8807-1e4ebb8f8685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204e20d-6b')
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUrtipnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:56:32 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[748e7afa-8de4-42c9-a3b5-1dda948a5d0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e91edd-b063-4192-9e0f-d255eaa7318d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba845ed480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbf73fe-133c-42cb-8be7-dbcb136e65c8]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: INFO nova.compute.manager [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Rebuilding instance
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc1de4a-65ab-4614-b70a-460411d5a0a3]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: INFO os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=770c4d59-3054-4195-94cf-facdbc1d5ca7,network=Network(d2542284-26af-46bb-b7a7-565471dfe1c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c4d59-30')
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:c6:45,bridge_name='br-int',has_traffic_filtering=True,id=686c5c08-20e1-482b-96c2-30a6e4e99203,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap686c5c08-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:c6:45,bridge_name='br-int',has_traffic_filtering=True,id=686c5c08-20e1-482b-96c2-30a6e4e99203,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap686c5c08-20') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e466120-05f0-42cc-9adf-c68ee73aa5e7]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap686c5c08-20, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lazy-loading 'trusted_certs' on Instance uuid dd796d18-9a13-40b8-9f4e-0a9dd93d4149 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d320b9a-1345-4dbf-99f1-1f889f0756fd]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[798b93eb-1d79-456f-a6e5-6454b1693d76]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: INFO os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:c6:45,bridge_name='br-int',has_traffic_filtering=True,id=686c5c08-20e1-482b-96c2-30a6e4e99203,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap686c5c08-20')
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=b6f5ddb9-961a-4001-9d43-740bc19cda82,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f5ddb9-96') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=b6f5ddb9-961a-4001-9d43-740bc19cda82,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f5ddb9-96') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6f5ddb9-96, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lazy-loading 'pci_requests' on Instance uuid dd796d18-9a13-40b8-9f4e-0a9dd93d4149 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: INFO os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=b6f5ddb9-961a-4001-9d43-740bc19cda82,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f5ddb9-96')
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:10:15,bridge_name='br-int',has_traffic_filtering=True,id=cabd5e47-5488-47f2-a96e-92de070a8267,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcabd5e47-54') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:10:15,bridge_name='br-int',has_traffic_filtering=True,id=cabd5e47-5488-47f2-a96e-92de070a8267,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcabd5e47-54') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5b1e94-ed2e-44b5-8f50-ca25c00f12ea]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lazy-loading 'pci_devices' on Instance uuid dd796d18-9a13-40b8-9f4e-0a9dd93d4149 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4, portal: 172.16.0.220,3260]
Jul 24 14:56:32 user nova-compute[70645]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4, portal: 172.16.0.220,3260] successful.
Jul 24 14:56:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcabd5e47-54, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:32 user nova-compute[70645]: WARNING nova.compute.manager [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-770c4d59-3054-4195-94cf-facdbc1d5ca7 for instance with vm_state active and task_state deleting.
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-unplugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:32 user nova-compute[70645]: WARNING nova.compute.manager [req-292481e2-069a-4a10-b4fa-a26993f5bf4c req-d07b1f8f-b5e7-40cf-a006-1315d5e2f1ac service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-b6f5ddb9-961a-4001-9d43-740bc19cda82 for instance with vm_state active and task_state deleting.
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lazy-loading 'resources' on Instance uuid dd796d18-9a13-40b8-9f4e-0a9dd93d4149 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lazy-loading 'migration_context' on Instance uuid dd796d18-9a13-40b8-9f4e-0a9dd93d4149 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e36b12a0-d0fd-4ad0-a6d8-95b8bb0876a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[20016cd3-5172-4d08-b468-fcfd4bf4bd7c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] <== disconnect_volume: return (407ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:56:32 user nova-compute[70645]: INFO os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:10:15,bridge_name='br-int',has_traffic_filtering=True,id=cabd5e47-5488-47f2-a96e-92de070a8267,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcabd5e47-54')
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:14:4e,bridge_name='br-int',has_traffic_filtering=True,id=be328240-94a4-416a-97d7-e379d07e2e64,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe328240-94') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:14:4e,bridge_name='br-int',has_traffic_filtering=True,id=be328240-94a4-416a-97d7-e379d07e2e64,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe328240-94') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe328240-94, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsafIMic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:56:32 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70645) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: INFO os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:14:4e,bridge_name='br-int',has_traffic_filtering=True,id=be328240-94a4-416a-97d7-e379d07e2e64,network=Network(3a25508c-7962-46c1-bade-7ac2510e5572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe328240-94')
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ae:82,bridge_name='br-int',has_traffic_filtering=True,id=76732353-b1bb-426d-ab39-0ccbefcef0a3,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76732353-b1') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ae:82,bridge_name='br-int',has_traffic_filtering=True,id=76732353-b1bb-426d-ab39-0ccbefcef0a3,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76732353-b1') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[45afa257-63ec-4aec-80b8-0fe82440fc18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76732353-b1, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: INFO os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ae:82,bridge_name='br-int',has_traffic_filtering=True,id=76732353-b1bb-426d-ab39-0ccbefcef0a3,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76732353-b1')
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T14:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1677375631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1677375631',id=10,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqs6AHrEhkuXp5n1qNR6asrCJRLI2hdJYRZtLCaaIvCWesbiJakP1YQvuwTTvQznbgKNGwByvx1yoq7XHXFXdHb137ZcDHVXRZcQ0qoYv+M8RFb+7U+alXVYP5CursnPw==',key_name='tempest-keypair-876731660',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eee83177e9c46e8a6b0579b93a33625',ramdisk_id='',reservation_id='r-16j30zec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-432897877',owner_user_name='tempest-TaggedBootDevicesTest_v242-432897877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c77c805d8534d58b109c9dce509378f',uuid=2518724a-a4f8-44e6-8820-1019289e65fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converting VIF {"id": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "address": "fa:16:3e:f5:52:1f", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5e5bdf-2f", "ovs_interfaceid": "0a5e5bdf-2fab-444f-ae3a-8cd841b013e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:52:1f,bridge_name='br-int',has_traffic_filtering=True,id=0a5e5bdf-2fab-444f-ae3a-8cd841b013e9,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5e5bdf-2f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:52:1f,bridge_name='br-int',has_traffic_filtering=True,id=0a5e5bdf-2fab-444f-ae3a-8cd841b013e9,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5e5bdf-2f') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a68c3a-bce0-4086-8464-b97dd392cd13]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:32 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba8462fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a5e5bdf-2f, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f339229d-4f1f-4258-ab34-1ccb26dc69e7]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:32 user nova-compute[70645]: INFO os_vif [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:52:1f,bridge_name='br-int',has_traffic_filtering=True,id=0a5e5bdf-2fab-444f-ae3a-8cd841b013e9,network=Network(e2732c06-615a-49ed-830e-6fec8cd9a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5e5bdf-2f')
Jul 24 14:56:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAqFcnyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:56:32 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.035s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c48fc82-442d-408d-95ee-ac8d43f47f1c]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:56:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cb2f88-1712-405d-b224-9064619dbf48]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-686c5c08-20e1-482b-96c2-30a6e4e99203 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-unplugged-686c5c08-20e1-482b-96c2-30a6e4e99203 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-686c5c08-20e1-482b-96c2-30a6e4e99203 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-686c5c08-20e1-482b-96c2-30a6e4e99203 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-686c5c08-20e1-482b-96c2-30a6e4e99203 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:33 user nova-compute[70645]: WARNING nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-686c5c08-20e1-482b-96c2-30a6e4e99203 for instance with vm_state active and task_state deleting.
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-unplugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:33 user nova-compute[70645]: WARNING nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 for instance with vm_state active and task_state deleting.
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Received event network-vif-unplugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Lock "a816f335-7f2e-4121-9667-237b22349724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] Lock "a816f335-7f2e-4121-9667-237b22349724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] No waiting events found dispatching network-vif-unplugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-ea77e06c-b8ce-4617-81fb-a35f41f621b8 req-93c026ba-c92f-4ce6-9836-39f03e6df4a2 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Received event network-vif-unplugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed1fcd4-a334-48f5-a358-ae84f87ff34b]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a161e044-f8b9-4c7a-b019-2491eea88a8f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fd1332-ef57-434d-8dea-46b3382130d5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321, portal: 172.16.0.220,3260]
Jul 24 14:56:33 user nova-compute[70645]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321, portal: 172.16.0.220,3260] successful.
Jul 24 14:56:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c9e837-c0a9-4f8d-971d-6574c794f321 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6cdcbf-3a3a-4429-9d33-aa1a622293a0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] <== disconnect_volume: return (419ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.274s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sILZWwkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:56:33 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7863b589-e6ee-4ddb-98ac-004b88df9332]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad35f8ed-cace-45b9-b857-5afec54de79a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba845eeb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4'): ({'sde'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Removing single pathed devices sde {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[99353296-d95d-47cf-8af4-ff7cb6675493]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a282f3a-c86e-48dd-ae5e-bc0abad4111e]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Flushing IO for device /dev/sde {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0700df64-df4e-4523-9140-435c3f0d4f77]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-e7583f88-2526-42c3-851f-31cad0cd3ffb req-b5639585-8638-45ea-9509-ddb565012e17 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e7583f88-2526-42c3-851f-31cad0cd3ffb req-b5639585-8638-45ea-9509-ddb565012e17 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e7583f88-2526-42c3-851f-31cad0cd3ffb req-b5639585-8638-45ea-9509-ddb565012e17 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e7583f88-2526-42c3-851f-31cad0cd3ffb req-b5639585-8638-45ea-9509-ddb565012e17 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-e7583f88-2526-42c3-851f-31cad0cd3ffb req-b5639585-8638-45ea-9509-ddb565012e17 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:33 user nova-compute[70645]: WARNING nova.compute.manager [req-e7583f88-2526-42c3-851f-31cad0cd3ffb req-b5639585-8638-45ea-9509-ddb565012e17 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-be328240-94a4-416a-97d7-e379d07e2e64 for instance with vm_state active and task_state deleting.
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[161f1d50-b8e3-449c-9741-f7a2ec5caf4e]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] SCSI volumes sde have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9746e2b4-fb42-4bc7-b718-6af390120920]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8112be4c-7c27-4e12-aefa-765e9d3a142f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4, portal: 172.16.0.220,3260]
Jul 24 14:56:33 user nova-compute[70645]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4, portal: 172.16.0.220,3260] successful.
Jul 24 14:56:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484b7324-9c66-458e-9fb0-94c5bc0871d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa7d411-1dbe-4eaf-8cc7-0bdae8b825c6]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] <== disconnect_volume: return (657ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.378s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CNLUdzuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:56:33 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:56:33 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Instance destroyed successfully.
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e60a43-6cfa-4fcc-9dd9-c98fc6dc94d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Instance destroyed successfully.
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-857172397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-688018022',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwoqgcpuew/lBL0A4HvDTZZKuMR4W08vCGF6DHg1WPwF1CRmpQpivSWEIG4F/2elmJ0HJ8+k9QG4CGPETqeUnBFSkbmxAYPCMF6V6tJyegjLzXd8TOfUwgbFBlNNmwaPA==',key_name='tempest-keypair-1741933867',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='31b3ae943a2a40b6a83674d048fa7805',ramdisk_id='',reservation_id='r-9kpb6uxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-870483127',owner_user_name='tempest-ServerActionsV293TestJSON-870483127-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:56:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd2d003c18c4541b9c6f2ae64cc95f6',uuid=dd796d18-9a13-40b8-9f4e-0a9dd93d4149,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converting VIF {"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_vif [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8682dc45-20, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:56:33 user nova-compute[70645]: INFO os_vif [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20')
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[29125c36-ca34-4b99-b160-c4b00904bf1e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:33 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba94122680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92'): ({'sdd'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Removing single pathed devices sdd {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCvVFDMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:56:33 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2437c89f-1d8b-45eb-bfd8-a6c099d2fafa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9061b130-2b82-46fd-b5f4-242e829b4dcc]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Flushing IO for device /dev/sdd {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e484c749-2725-4337-83a8-2aa0e3c7c4b3]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[127346f8-0996-45a0-aa10-a090a3796147]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eefc33b-9f13-4138-ade7-079eb4106334]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcca0b0-f655-4a77-961e-7db14ed51427]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92, portal: 172.16.0.220,3260]
Jul 24 14:56:33 user nova-compute[70645]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92, portal: 172.16.0.220,3260] successful.
Jul 24 14:56:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f1d687d-8f99-4341-8f13-70659cca8c92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a669936e-41b8-42f0-9aad-23a4f0f52a3d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] <== disconnect_volume: return (730ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:56:34 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Deleting instance files /opt/stack/data/nova/instances/d2c5d524-aade-4229-b12a-f953c25eaa40_del
Jul 24 14:56:34 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Deletion of /opt/stack/data/nova/instances/d2c5d524-aade-4229-b12a-f953c25eaa40_del complete
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.356s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[610ed5e4-56cb-4bd8-ba29-8d1375e9b8e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3637cd-e6f0-45f7-9eba-af2596e5199a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:34 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:34 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba847169e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f'): ({'sdg'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Removing single pathed devices sdg {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: INFO nova.compute.manager [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Took 6.16 seconds to destroy the instance on the hypervisor.
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d315a5-e54f-44e7-963f-22b975bcaf81]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebee760f-6fa1-499e-b085-ee63d658945c]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Flushing IO for device /dev/sdg {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae53a52-0c51-4a3d-bbd6-bf32ac451f47]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[290aa53d-6ccc-45fe-a7a3-f23eaea0df53]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] SCSI volumes sdg have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3439d072-372b-4144-af64-23bfa6dea5b4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59f41eb-f538-4934-9e8b-9684a57c4644]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f, portal: 172.16.0.220,3260]
Jul 24 14:56:34 user nova-compute[70645]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f, portal: 172.16.0.220,3260] successful.
Jul 24 14:56:34 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02ec91b-9962-41a2-8ffa-d64bf810057f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[704f5834-404f-45eb-ba3e-7ef3f3b6fa5d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] <== disconnect_volume: return (655ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.578s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGZfwHrb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:56:34 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dfe9fa-d829-4d41-9d99-4cb21e9c968a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[970f181a-b1ec-403c-b822-e72eb451ea15]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:34 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:34 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba845ed120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d'): ({'sdf'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Removing single pathed devices sdf {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad0ff6f-33f8-4cf3-be1f-b7f379f9c6af]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: a816f335-7f2e-4121-9667-237b22349724] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e1ae4a-e09c-4b2b-9c63-2fdbdf148345]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Flushing IO for device /dev/sdf {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[84289600-5e25-4147-9503-2b6cf1eaa116]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: a816f335-7f2e-4121-9667-237b22349724] Took 2.31 seconds to deallocate network for instance.
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.060s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[737729a0-9293-4e76-b582-4b7a653f6135]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] SCSI volumes sdf have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7d640e-6d37-41f2-a31a-05fe1d1c92ec]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c4ac80-4602-499e-a306-f7e83bfc56d3]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260]
Jul 24 14:56:34 user nova-compute[70645]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260] successful.
Jul 24 14:56:34 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3048b9-4290-41b1-a735-424c34969db0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] <== disconnect_volume: return (980ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:56:34 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Deleting instance files /opt/stack/data/nova/instances/dd796d18-9a13-40b8-9f4e-0a9dd93d4149_del
Jul 24 14:56:34 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Deletion of /opt/stack/data/nova/instances/dd796d18-9a13-40b8-9f4e-0a9dd93d4149_del complete
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.403s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bacd310-36c4-4fd0-9070-fa2f61ace5e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd396ba9-b41b-410e-bb67-a87af61552dc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 (non-flash)
Jul 24 14:56:34 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba845ec3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357'): ({'sdh'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Removing single pathed devices sdh {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad477c5-04cc-42f0-8981-319ef55cd104]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[02595096-18e4-4fcc-a71f-f495d0e280b4]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Flushing IO for device /dev/sdh {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-unplugged-cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-cabd5e47-5488-47f2-a96e-92de070a8267 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:34 user nova-compute[70645]: WARNING nova.compute.manager [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-cabd5e47-5488-47f2-a96e-92de070a8267 for instance with vm_state active and task_state deleting.
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-unplugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-unplugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-2021d9a6-c458-4e82-a3ba-ff1e81148b77 req-577e18a3-70a0-449a-8e41-097f281dd8d9 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Received event network-vif-deleted-ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[db826bfd-2eb7-44a1-a9d8-464fc8ff7a26]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.058s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aef399-a573-4e4c-b209-e9f7a299a115]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] SCSI volumes sdh have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08727c3-6e27-46ee-855c-98e6b0787bbf]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:34 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance dd796d18-9a13-40b8-9f4e-0a9dd93d4149 could not be found.
Jul 24 14:56:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCvVFDMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:56:34 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 14:56:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f47a8-287a-4ec5-8e05-c9e2ea76001d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357, portal: 172.16.0.220,3260]
Jul 24 14:56:35 user nova-compute[70645]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357, portal: 172.16.0.220,3260] successful.
Jul 24 14:56:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59e9beb5-ae4e-49c5-9f9d-1cbd15cdb357 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c23660f-5a1e-4342-aafa-cccaf8096a67]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] <== disconnect_volume: return (737ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:56:35 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Deleting instance files /opt/stack/data/nova/instances/2518724a-a4f8-44e6-8820-1019289e65fc_del
Jul 24 14:56:35 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Deletion of /opt/stack/data/nova/instances/2518724a-a4f8-44e6-8820-1019289e65fc_del complete
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.071s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Received event network-vif-plugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] Acquiring lock "a816f335-7f2e-4121-9667-237b22349724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] Lock "a816f335-7f2e-4121-9667-237b22349724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] Lock "a816f335-7f2e-4121-9667-237b22349724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] No waiting events found dispatching network-vif-plugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:35 user nova-compute[70645]: WARNING nova.compute.manager [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] [instance: a816f335-7f2e-4121-9667-237b22349724] Received unexpected event network-vif-plugged-ca039191-1724-4ec8-ac6f-0264f8d8c7ff for instance with vm_state deleted and task_state None.
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-vif-unplugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] No waiting events found dispatching network-vif-unplugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:35 user nova-compute[70645]: WARNING nova.compute.manager [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received unexpected event network-vif-unplugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b for instance with vm_state active and task_state rebuilding.
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] No waiting events found dispatching network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:35 user nova-compute[70645]: WARNING nova.compute.manager [req-ec2725a1-4c39-4d02-8161-0b49cfe0427d req-ba2a40dc-18ab-4cc8-8250-7f640545f692 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received unexpected event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b for instance with vm_state active and task_state rebuilding.
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[836de01b-5a4c-4627-9954-c7d5cc307dd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b102f3-23fd-4c95-99a4-c655b4c993f9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba845ec550>, {}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Disconnecting from: [] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] <== disconnect_volume: return (143ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.528s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:35 user nova-compute[70645]: INFO nova.compute.manager [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Took 5.40 seconds to destroy the instance on the hypervisor.
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:56:35 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Deleted allocations for instance a816f335-7f2e-4121-9667-237b22349724
Jul 24 14:56:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3d02e687-f9f2-4613-bcd3-f2e3d6149410 tempest-TestVolumeSwap-1001337689 tempest-TestVolumeSwap-1001337689-project-member] Lock "a816f335-7f2e-4121-9667-237b22349724" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.778s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Preparing to wait for external event volume-reimaged-93c54412-e306-45ab-a248-e0eafd284a4d {{(pid=70645) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 24 14:56:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-e389c0fc-de28-4146-b856-448839d3625b req-fbdef13b-bf67-4d6c-9f04-3d7e5df3b5b6 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-plugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e389c0fc-de28-4146-b856-448839d3625b req-fbdef13b-bf67-4d6c-9f04-3d7e5df3b5b6 service nova] Acquiring lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e389c0fc-de28-4146-b856-448839d3625b req-fbdef13b-bf67-4d6c-9f04-3d7e5df3b5b6 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e389c0fc-de28-4146-b856-448839d3625b req-fbdef13b-bf67-4d6c-9f04-3d7e5df3b5b6 service nova] Lock "2518724a-a4f8-44e6-8820-1019289e65fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-e389c0fc-de28-4146-b856-448839d3625b req-fbdef13b-bf67-4d6c-9f04-3d7e5df3b5b6 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] No waiting events found dispatching network-vif-plugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:56:36 user nova-compute[70645]: WARNING nova.compute.manager [req-e389c0fc-de28-4146-b856-448839d3625b req-fbdef13b-bf67-4d6c-9f04-3d7e5df3b5b6 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received unexpected event network-vif-plugged-76732353-b1bb-426d-ab39-0ccbefcef0a3 for instance with vm_state active and task_state deleting.
Jul 24 14:56:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-deleted-cb07e6e6-49dd-4330-89b5-6b93af6ed2bd {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:37 user nova-compute[70645]: INFO nova.compute.manager [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Neutron deleted interface cb07e6e6-49dd-4330-89b5-6b93af6ed2bd; detaching it from the instance and deleting it from the info cache
Jul 24 14:56:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [{"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "address": "fa:16:3e:55:bd:fe", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36dd022-bb", "ovs_interfaceid": "a36dd022-bb0f-4848-8fbf-f5c4fb84179c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Detach interface failed, port_id=cb07e6e6-49dd-4330-89b5-6b93af6ed2bd, reason: Instance d2c5d524-aade-4229-b12a-f953c25eaa40 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 14:56:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-deleted-a36dd022-bb0f-4848-8fbf-f5c4fb84179c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:37 user nova-compute[70645]: INFO nova.compute.manager [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Neutron deleted interface a36dd022-bb0f-4848-8fbf-f5c4fb84179c; detaching it from the instance and deleting it from the info cache
Jul 24 14:56:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [{"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0204e20d-6b04-425c-9141-236a993c3d98", "address": "fa:16:3e:44:c1:a8", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204e20d-6b", "ovs_interfaceid": "0204e20d-6b04-425c-9141-236a993c3d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Detach interface failed, port_id=a36dd022-bb0f-4848-8fbf-f5c4fb84179c, reason: Instance d2c5d524-aade-4229-b12a-f953c25eaa40 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 14:56:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-deleted-0204e20d-6b04-425c-9141-236a993c3d98 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:37 user nova-compute[70645]: INFO nova.compute.manager [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Neutron deleted interface 0204e20d-6b04-425c-9141-236a993c3d98; detaching it from the instance and deleting it from the info cache
Jul 24 14:56:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [{"id": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "address": "fa:16:3e:a9:60:ef", "network": {"id": "3dd2fe24-cb5b-4370-82bb-75def0166773", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1269713612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9a98e9-ec", "ovs_interfaceid": "6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "address": "fa:16:3e:dd:5e:80", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1a0d8c-19", "ovs_interfaceid": "db1a0d8c-19bf-4a1e-b526-7261733683c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1022a74-2c30-4f91-b050-85f97db29e4d", "address": "fa:16:3e:9c:b5:b0", "network": {"id": "3ba7154c-601d-4010-8553-bd59d0abccf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-85139695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1022a74-2c", "ovs_interfaceid": "d1022a74-2c30-4f91-b050-85f97db29e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "address": "fa:16:3e:59:fc:01", "network": {"id": "cfe68c5f-38e0-4c61-8807-1e4ebb8f8685", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862846169", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "374ec2672f3b4469aca169a69c153520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a1f009-ae", "ovs_interfaceid": "e2a1f009-ae21-459d-ae50-8b3b6fb3d545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-ca15f27b-0b06-402e-80a8-8e1819a1d96b req-f0607d71-671c-4b5c-8c39-57e1543a0e8b service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Detach interface failed, port_id=0204e20d-6b04-425c-9141-236a993c3d98, reason: Instance d2c5d524-aade-4229-b12a-f953c25eaa40 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 14:56:38 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:38 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Took 4.02 seconds to deallocate network for instance.
Jul 24 14:56:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-deleted-0a5e5bdf-2fab-444f-ae3a-8cd841b013e9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:38 user nova-compute[70645]: INFO nova.compute.manager [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Neutron deleted interface 0a5e5bdf-2fab-444f-ae3a-8cd841b013e9; detaching it from the instance and deleting it from the info cache
Jul 24 14:56:38 user nova-compute[70645]: DEBUG nova.network.neutron [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [{"id": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "address": "fa:16:3e:8d:1e:08", "network": {"id": "d2542284-26af-46bb-b7a7-565471dfe1c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1889872827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c4d59-30", "ovs_interfaceid": "770c4d59-3054-4195-94cf-facdbc1d5ca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Detach interface failed, port_id=0a5e5bdf-2fab-444f-ae3a-8cd841b013e9, reason: Instance 2518724a-a4f8-44e6-8820-1019289e65fc could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 14:56:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-deleted-770c4d59-3054-4195-94cf-facdbc1d5ca7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:38 user nova-compute[70645]: INFO nova.compute.manager [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Neutron deleted interface 770c4d59-3054-4195-94cf-facdbc1d5ca7; detaching it from the instance and deleting it from the info cache
Jul 24 14:56:38 user nova-compute[70645]: DEBUG nova.network.neutron [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [{"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be328240-94a4-416a-97d7-e379d07e2e64", "address": "fa:16:3e:d8:14:4e", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe328240-94", "ovs_interfaceid": "be328240-94a4-416a-97d7-e379d07e2e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Detach interface failed, port_id=770c4d59-3054-4195-94cf-facdbc1d5ca7, reason: Instance 2518724a-a4f8-44e6-8820-1019289e65fc could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 14:56:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-deleted-be328240-94a4-416a-97d7-e379d07e2e64 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:39 user nova-compute[70645]: INFO nova.compute.manager [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Neutron deleted interface be328240-94a4-416a-97d7-e379d07e2e64; detaching it from the instance and deleting it from the info cache
Jul 24 14:56:39 user nova-compute[70645]: DEBUG nova.network.neutron [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [{"id": "686c5c08-20e1-482b-96c2-30a6e4e99203", "address": "fa:16:3e:99:c6:45", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686c5c08-20", "ovs_interfaceid": "686c5c08-20e1-482b-96c2-30a6e4e99203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "address": "fa:16:3e:b1:07:d2", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f5ddb9-96", "ovs_interfaceid": "b6f5ddb9-961a-4001-9d43-740bc19cda82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cabd5e47-5488-47f2-a96e-92de070a8267", "address": "fa:16:3e:f9:10:15", "network": {"id": "3a25508c-7962-46c1-bade-7ac2510e5572", "bridge": "br-int", "label": "tempest-device-tagging-net1-425874350", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcabd5e47-54", "ovs_interfaceid": "cabd5e47-5488-47f2-a96e-92de070a8267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "address": "fa:16:3e:f9:ae:82", "network": {"id": "e2732c06-615a-49ed-830e-6fec8cd9a34c", "bridge": "br-int", "label": "tempest-device-tagging-net2-611639534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9eee83177e9c46e8a6b0579b93a33625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76732353-b1", "ovs_interfaceid": "76732353-b1bb-426d-ab39-0ccbefcef0a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-d3174aef-2097-4cb0-abbd-b9fb2e6db661 req-d0e6f13c-afb1-40f0-a71a-40e901076af3 service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Detach interface failed, port_id=be328240-94a4-416a-97d7-e379d07e2e64, reason: Instance 2518724a-a4f8-44e6-8820-1019289e65fc could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 14:56:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-0d9e2c54-743e-41fe-aa93-076196bedb63 req-ca31d37d-113a-43e0-93f5-972fc77b6998 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-deleted-6c9a98e9-ecc3-4b9d-b33d-5c6a8928412f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-0d9e2c54-743e-41fe-aa93-076196bedb63 req-ca31d37d-113a-43e0-93f5-972fc77b6998 service nova] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Received event network-vif-deleted-e2a1f009-ae21-459d-ae50-8b3b6fb3d545 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:39 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:39 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Took 4.55 seconds to deallocate network for instance.
Jul 24 14:56:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:40 user nova-compute[70645]: INFO nova.compute.manager [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Took 2.49 seconds to detach 3 volumes for instance.
Jul 24 14:56:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d72fb2c-3ecf-4e3a-958f-47a300105504 req-f0478dcb-505a-4e13-aca8-31decc5450da service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-deleted-cabd5e47-5488-47f2-a96e-92de070a8267 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d72fb2c-3ecf-4e3a-958f-47a300105504 req-f0478dcb-505a-4e13-aca8-31decc5450da service nova] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Received event network-vif-deleted-76732353-b1bb-426d-ab39-0ccbefcef0a3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:41 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:56:41 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:56:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:41 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Deleted allocations for instance d2c5d524-aade-4229-b12a-f953c25eaa40
Jul 24 14:56:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5438c6b-4ea4-41cd-8f37-cc90ceddc850 tempest-TaggedBootDevicesTest-1354903190 tempest-TaggedBootDevicesTest-1354903190-project-member] Lock "d2c5d524-aade-4229-b12a-f953c25eaa40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.351s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:42 user nova-compute[70645]: INFO nova.compute.manager [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Took 2.41 seconds to detach 3 volumes for instance.
Jul 24 14:56:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:42 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:56:42 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:56:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.710s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:42 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Deleted allocations for instance 2518724a-a4f8-44e6-8820-1019289e65fc
Jul 24 14:56:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ddbcd86-d873-4d5c-a189-1352b10ef451 tempest-TaggedBootDevicesTest_v242-432897877 tempest-TaggedBootDevicesTest_v242-432897877-project-member] Lock "2518724a-a4f8-44e6-8820-1019289e65fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.272s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:45 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210590.1825452, d2c5d524-aade-4229-b12a-f953c25eaa40 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:56:45 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] VM Stopped (Lifecycle Event)
Jul 24 14:56:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d3e2e250-9834-4fa4-ad3f-7d9b2a618596 None None] [instance: d2c5d524-aade-4229-b12a-f953c25eaa40] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:56:46 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210591.8319933, a816f335-7f2e-4121-9667-237b22349724 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:56:46 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: a816f335-7f2e-4121-9667-237b22349724] VM Stopped (Lifecycle Event)
Jul 24 14:56:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-520ae04b-7fa0-485a-98e9-a6a8bf001dad None None] [instance: a816f335-7f2e-4121-9667-237b22349724] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:56:47 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210592.163861, 2518724a-a4f8-44e6-8820-1019289e65fc => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:56:47 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] VM Stopped (Lifecycle Event)
Jul 24 14:56:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-899d768e-1db1-4091-b13e-2d591ace43d9 None None] [instance: 2518724a-a4f8-44e6-8820-1019289e65fc] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:56:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:48 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210593.6483357, dd796d18-9a13-40b8-9f4e-0a9dd93d4149 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:56:48 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] VM Stopped (Lifecycle Event)
Jul 24 14:56:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-75d1348c-76a4-4c6f-93c2-733b48e5f832 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:56:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-c7a313f0-ae6b-4a23-bf46-bea6a495f0b4 req-fce6e393-14fe-451b-aaac-86fb5a04d127 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Received event network-changed-ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-c7a313f0-ae6b-4a23-bf46-bea6a495f0b4 req-fce6e393-14fe-451b-aaac-86fb5a04d127 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Refreshing instance network info cache due to event network-changed-ffd805b9-7af4-452a-96ba-8abd05010a47. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:56:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c7a313f0-ae6b-4a23-bf46-bea6a495f0b4 req-fce6e393-14fe-451b-aaac-86fb5a04d127 service nova] Acquiring lock "refresh_cache-ff0bb392-a296-45a0-a102-f8b0e1c9d41a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:56:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c7a313f0-ae6b-4a23-bf46-bea6a495f0b4 req-fce6e393-14fe-451b-aaac-86fb5a04d127 service nova] Acquired lock "refresh_cache-ff0bb392-a296-45a0-a102-f8b0e1c9d41a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:56:48 user nova-compute[70645]: DEBUG nova.network.neutron [req-c7a313f0-ae6b-4a23-bf46-bea6a495f0b4 req-fce6e393-14fe-451b-aaac-86fb5a04d127 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Refreshing network info cache for port ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:56:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-c7a313f0-ae6b-4a23-bf46-bea6a495f0b4 req-fce6e393-14fe-451b-aaac-86fb5a04d127 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Updated VIF entry in instance network info cache for port ffd805b9-7af4-452a-96ba-8abd05010a47. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:56:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-c7a313f0-ae6b-4a23-bf46-bea6a495f0b4 req-fce6e393-14fe-451b-aaac-86fb5a04d127 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Updating instance_info_cache with network_info: [{"id": "ffd805b9-7af4-452a-96ba-8abd05010a47", "address": "fa:16:3e:22:c2:66", "network": {"id": "7d870511-075a-4fa7-83ef-9147e626f8f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1824197985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603f18c021ae49fab9aaaa4b5f1fa780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd805b9-7a", "ovs_interfaceid": "ffd805b9-7af4-452a-96ba-8abd05010a47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:56:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c7a313f0-ae6b-4a23-bf46-bea6a495f0b4 req-fce6e393-14fe-451b-aaac-86fb5a04d127 service nova] Releasing lock "refresh_cache-ff0bb392-a296-45a0-a102-f8b0e1c9d41a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-f597b7ed-b2a3-46c9-8763-f039b329d44e req-5aa64917-b0f7-49de-a4c9-371a6e7944f2 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event volume-reimaged-93c54412-e306-45ab-a248-e0eafd284a4d {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f597b7ed-b2a3-46c9-8763-f039b329d44e req-5aa64917-b0f7-49de-a4c9-371a6e7944f2 service nova] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f597b7ed-b2a3-46c9-8763-f039b329d44e req-5aa64917-b0f7-49de-a4c9-371a6e7944f2 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f597b7ed-b2a3-46c9-8763-f039b329d44e req-5aa64917-b0f7-49de-a4c9-371a6e7944f2 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-f597b7ed-b2a3-46c9-8763-f039b329d44e req-5aa64917-b0f7-49de-a4c9-371a6e7944f2 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Processing event volume-reimaged-93c54412-e306-45ab-a248-e0eafd284a4d {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10772}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:56:51 user nova-compute[70645]: INFO nova.virt.block_device [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Booting with volume 93c54412-e306-45ab-a248-e0eafd284a4d at /dev/vda
Jul 24 14:56:51 user nova-compute[70645]: DEBUG os_brick.utils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2dd480-12cd-4125-ad9e-2199b31f8ff9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[caab41fe-d89a-488a-81ff-dfe140af1d50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e472e904-7a05-4f00-84db-acd65ce3ef25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4457106e-6f28-4310-be04-f853e2ac7401]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:56:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:56:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:56:52 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:56:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4a3f71-6d1f-4af7-9667-af177d3ecd9e]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:56:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:56:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:56:52 user nova-compute[70645]: DEBUG os_brick.utils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:56:52 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Updating existing volume attachment record: d42c311a-70ae-44b2-a29f-f8930281e7e4 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:56:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lazy-loading 'flavor' on Instance uuid ff0bb392-a296-45a0-a102-f8b0e1c9d41a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:53 user nova-compute[70645]: INFO nova.compute.manager [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Attaching volume 2078a518-214e-4029-b820-fb393e0e884d to /dev/vdb
Jul 24 14:56:53 user nova-compute[70645]: DEBUG os_brick.utils [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9e2887-88c2-4a8a-8396-93912a9d0499]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e3edb7-4088-418d-a59f-698168b9f94d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[94887ed1-8e57-46b0-99aa-0d17c6fee654]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ff9e88-ebca-41e9-b630-51b8c2ed66b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:56:53 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:56:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c53a1c-c2fd-48ab-9990-5f4f6363942e]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG os_brick.utils [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Updating existing volume attachment record: 58815413-6f7a-4162-b755-9a947928d8f0 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:56:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:56:59 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Creating image(s)
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Ensure instance console log exists: /opt/stack/data/nova/instances/dd796d18-9a13-40b8-9f4e-0a9dd93d4149/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Start _get_guest_xml network_info=[{"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd42c311a-70ae-44b2-a29f-f8930281e7e4', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCvVFDMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd796d18-9a13-40b8-9f4e-0a9dd93d4149', 'attached_at': '', 'detached_at': '', 'volume_id': '93c54412-e306-45ab-a248-e0eafd284a4d', 'serial': '93c54412-e306-45ab-a248-e0eafd284a4d'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:56:59 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 14:56:59 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lazy-loading 'vcpu_model' on Instance uuid dd796d18-9a13-40b8-9f4e-0a9dd93d4149 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCvVFDMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:56:59 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:56:59 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:56:59 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a4b0fe-86d1-42d3-b1e5-23e5ec770bb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:56:59 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[401add3f-8937-40d2-9ff0-086052169d18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d] added
Jul 24 14:56:59 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7f271b-26b8-4fc3-81b3-7b8ef60d5c49]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6605a-06f2-4085-9398-a562530c8518]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCvVFDMu {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCvVFDMu" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[990cf569-73a8-4871-ae8a-a996ffbc1478]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sCvVFDMu'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.118s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae802369-ae6f-4b62-a74b-998178a50a59]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e06c48-68d4-4cc1-b5b8-4f63efb4bf0b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:59 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:59 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[052b84fa-29f3-480d-a42b-9f545ff13c10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260]
Jul 24 14:56:59 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260] successful.
Jul 24 14:56:59 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efab984-96a6-4cb0-a0fe-9214045d66ab]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec758b1c-0bb2-41ae-b274-4516878ac85b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:59 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:59 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:56:59 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:56:59 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab269f4d-39d8-454d-b1cb-d18e12e92d9e]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:56:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCvVFDMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJReXVFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:57:00 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23632653038636636', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632653038636636', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.054s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:57:00 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:57:00 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdfaab4-5821-4b2a-8b2b-194e56e57d4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:57:00 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T14:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-857172397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-688018022',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwoqgcpuew/lBL0A4HvDTZZKuMR4W08vCGF6DHg1WPwF1CRmpQpivSWEIG4F/2elmJ0HJ8+k9QG4CGPETqeUnBFSkbmxAYPCMF6V6tJyegjLzXd8TOfUwgbFBlNNmwaPA==',key_name='tempest-keypair-1741933867',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='31b3ae943a2a40b6a83674d048fa7805',ramdisk_id='',reservation_id='r-9kpb6uxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-870483127',owner_user_name='tempest-ServerActionsV293TestJSON-870483127-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:56:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd2d003c18c4541b9c6f2ae64cc95f6',uuid=dd796d18-9a13-40b8-9f4e-0a9dd93d4149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converting VIF {"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:57:00 user nova-compute[70645]:   <uuid>dd796d18-9a13-40b8-9f4e-0a9dd93d4149</uuid>
Jul 24 14:57:00 user nova-compute[70645]:   <name>instance-0000000b</name>
Jul 24 14:57:00 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:57:00 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:57:00 user nova-compute[70645]:   <metadata>
Jul 24 14:57:00 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:57:00 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:57:00 user nova-compute[70645]:       <nova:name>tempest-ServerActionsV293TestJSON-server-857172397</nova:name>
Jul 24 14:57:00 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:56:59</nova:creationTime>
Jul 24 14:57:00 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:57:00 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:57:00 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:57:00 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:57:00 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:57:00 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:57:00 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:57:00 user nova-compute[70645]:       <nova:owner>
Jul 24 14:57:00 user nova-compute[70645]:         <nova:user uuid="bcd2d003c18c4541b9c6f2ae64cc95f6">tempest-ServerActionsV293TestJSON-870483127-project-member</nova:user>
Jul 24 14:57:00 user nova-compute[70645]:         <nova:project uuid="31b3ae943a2a40b6a83674d048fa7805">tempest-ServerActionsV293TestJSON-870483127</nova:project>
Jul 24 14:57:00 user nova-compute[70645]:       </nova:owner>
Jul 24 14:57:00 user nova-compute[70645]:       <nova:ports>
Jul 24 14:57:00 user nova-compute[70645]:         <nova:port uuid="8682dc45-20b4-4e10-aaaf-fa86015cad6b">
Jul 24 14:57:00 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 14:57:00 user nova-compute[70645]:         </nova:port>
Jul 24 14:57:00 user nova-compute[70645]:       </nova:ports>
Jul 24 14:57:00 user nova-compute[70645]:     </nova:instance>
Jul 24 14:57:00 user nova-compute[70645]:   </metadata>
Jul 24 14:57:00 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:57:00 user nova-compute[70645]:     <system>
Jul 24 14:57:00 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:57:00 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:57:00 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:57:00 user nova-compute[70645]:       <entry name="serial">dd796d18-9a13-40b8-9f4e-0a9dd93d4149</entry>
Jul 24 14:57:00 user nova-compute[70645]:       <entry name="uuid">dd796d18-9a13-40b8-9f4e-0a9dd93d4149</entry>
Jul 24 14:57:00 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:57:00 user nova-compute[70645]:     </system>
Jul 24 14:57:00 user nova-compute[70645]:   </sysinfo>
Jul 24 14:57:00 user nova-compute[70645]:   <os>
Jul 24 14:57:00 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:57:00 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:57:00 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:57:00 user nova-compute[70645]:   </os>
Jul 24 14:57:00 user nova-compute[70645]:   <features>
Jul 24 14:57:00 user nova-compute[70645]:     <acpi/>
Jul 24 14:57:00 user nova-compute[70645]:     <apic/>
Jul 24 14:57:00 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:57:00 user nova-compute[70645]:   </features>
Jul 24 14:57:00 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:57:00 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:57:00 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:57:00 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:57:00 user nova-compute[70645]:   </clock>
Jul 24 14:57:00 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:57:00 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:57:00 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:57:00 user nova-compute[70645]:   </cpu>
Jul 24 14:57:00 user nova-compute[70645]:   <devices>
Jul 24 14:57:00 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 14:57:00 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:57:00 user nova-compute[70645]:       <source dev="/dev/sdb"/>
Jul 24 14:57:00 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:57:00 user nova-compute[70645]:       <serial>93c54412-e306-45ab-a248-e0eafd284a4d</serial>
Jul 24 14:57:00 user nova-compute[70645]:     </disk>
Jul 24 14:57:00 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:57:00 user nova-compute[70645]:       <mac address="fa:16:3e:ea:18:90"/>
Jul 24 14:57:00 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:00 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:57:00 user nova-compute[70645]:       <target dev="tap8682dc45-20"/>
Jul 24 14:57:00 user nova-compute[70645]:     </interface>
Jul 24 14:57:00 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:57:00 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/dd796d18-9a13-40b8-9f4e-0a9dd93d4149/console.log" append="off"/>
Jul 24 14:57:00 user nova-compute[70645]:     </serial>
Jul 24 14:57:00 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:57:00 user nova-compute[70645]:     <video>
Jul 24 14:57:00 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:00 user nova-compute[70645]:     </video>
Jul 24 14:57:00 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:57:00 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:57:00 user nova-compute[70645]:     </rng>
Jul 24 14:57:00 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:57:00 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:57:00 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:57:00 user nova-compute[70645]:     </memballoon>
Jul 24 14:57:00 user nova-compute[70645]:   </devices>
Jul 24 14:57:00 user nova-compute[70645]: </domain>
Jul 24 14:57:00 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T14:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-857172397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-688018022',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwoqgcpuew/lBL0A4HvDTZZKuMR4W08vCGF6DHg1WPwF1CRmpQpivSWEIG4F/2elmJ0HJ8+k9QG4CGPETqeUnBFSkbmxAYPCMF6V6tJyegjLzXd8TOfUwgbFBlNNmwaPA==',key_name='tempest-keypair-1741933867',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='31b3ae943a2a40b6a83674d048fa7805',ramdisk_id='',reservation_id='r-9kpb6uxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-870483127',owner_user_name='tempest-ServerActionsV293TestJSON-870483127-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:56:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd2d003c18c4541b9c6f2ae64cc95f6',uuid=dd796d18-9a13-40b8-9f4e-0a9dd93d4149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converting VIF {"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_vif [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8491eeb-51a4-4089-8a32-01ed24043419]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d] added
Jul 24 14:57:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8682dc45-20, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8682dc45-20, col_values=(('external_ids', {'iface-id': '8682dc45-20b4-4e10-aaaf-fa86015cad6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:18:90', 'vm-uuid': 'dd796d18-9a13-40b8-9f4e-0a9dd93d4149'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:00 user nova-compute[70645]: INFO os_vif [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20')
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7a8fd8-376f-497d-8dca-50df3b3d0925]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86cb8da-b277-4028-9190-7938c9b3e372]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJReXVFQ {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJReXVFQ" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f22af0d-da5f-44ef-bbb1-3dd70a0798ac]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uJReXVFQ'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] No VIF found with MAC fa:16:3e:ea:18:90, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c41e752-8431-40af-9b81-dc90b4a1972e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[25005564-51eb-40a5-a28e-b76b66c2632b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:57:00 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:57:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:57:00 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:57:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b0d351-a1c5-4b4c-ba88-3e577b40fc3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d, portal: 172.16.0.220,3260]
Jul 24 14:57:00 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d, portal: 172.16.0.220,3260] successful.
Jul 24 14:57:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed139ad8-4db2-4d67-a745-2dfd7de7b478]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b679157-5d5d-4720-9166-26e7c7f404d3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:57:00 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:57:00 user nova-compute[70645]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d (non-flash)
Jul 24 14:57:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:57:00 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:57:00 user nova-compute[70645]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d (non-flash)
Jul 24 14:57:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee00a3b1-aa08-47f7-a873-bc1d66ee27d9]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:57:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJReXVFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:57:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:57:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26534666239303330', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:57:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534666239303330', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:57:01 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lazy-loading 'flavor' on Instance uuid ff0bb392-a296-45a0-a102-f8b0e1c9d41a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 14:57:01 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:57:01 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 14:57:01 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:57:01 user nova-compute[70645]:   <serial>2078a518-214e-4029-b820-fb393e0e884d</serial>
Jul 24 14:57:01 user nova-compute[70645]: </disk>
Jul 24 14:57:01 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 14:57:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-3add7d85-e628-4e38-8ef1-ec9e1160da8d req-f27fd0b0-47a6-4df9-8e42-2cf61b8e8cc9 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3add7d85-e628-4e38-8ef1-ec9e1160da8d req-f27fd0b0-47a6-4df9-8e42-2cf61b8e8cc9 service nova] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3add7d85-e628-4e38-8ef1-ec9e1160da8d req-f27fd0b0-47a6-4df9-8e42-2cf61b8e8cc9 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3add7d85-e628-4e38-8ef1-ec9e1160da8d req-f27fd0b0-47a6-4df9-8e42-2cf61b8e8cc9 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-3add7d85-e628-4e38-8ef1-ec9e1160da8d req-f27fd0b0-47a6-4df9-8e42-2cf61b8e8cc9 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] No waiting events found dispatching network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:02 user nova-compute[70645]: WARNING nova.compute.manager [req-3add7d85-e628-4e38-8ef1-ec9e1160da8d req-f27fd0b0-47a6-4df9-8e42-2cf61b8e8cc9 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received unexpected event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b for instance with vm_state active and task_state rebuild_spawning.
Jul 24 14:57:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] No VIF found with MAC fa:16:3e:22:c2:66, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:57:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f4c23751-2dbe-4dca-b57c-185bde91abb4 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.201s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-8e0768f9-7d39-419a-9e6a-63960fff5a31 req-9ad4e3e7-66a1-4b30-aad6-3c763e2915e1 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8e0768f9-7d39-419a-9e6a-63960fff5a31 req-9ad4e3e7-66a1-4b30-aad6-3c763e2915e1 service nova] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8e0768f9-7d39-419a-9e6a-63960fff5a31 req-9ad4e3e7-66a1-4b30-aad6-3c763e2915e1 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8e0768f9-7d39-419a-9e6a-63960fff5a31 req-9ad4e3e7-66a1-4b30-aad6-3c763e2915e1 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-8e0768f9-7d39-419a-9e6a-63960fff5a31 req-9ad4e3e7-66a1-4b30-aad6-3c763e2915e1 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] No waiting events found dispatching network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:04 user nova-compute[70645]: WARNING nova.compute.manager [req-8e0768f9-7d39-419a-9e6a-63960fff5a31 req-9ad4e3e7-66a1-4b30-aad6-3c763e2915e1 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received unexpected event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b for instance with vm_state active and task_state rebuild_spawning.
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210624.7207448, dd796d18-9a13-40b8-9f4e-0a9dd93d4149 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:57:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] VM Resumed (Lifecycle Event)
Jul 24 14:57:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Instance spawned successfully.
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210624.722141, dd796d18-9a13-40b8-9f4e-0a9dd93d4149 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:57:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] VM Started (Lifecycle Event)
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:57:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70645) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:04 user nova-compute[70645]: INFO nova.compute.manager [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Detaching volume 2078a518-214e-4029-b820-fb393e0e884d
Jul 24 14:57:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f597b7ed-b2a3-46c9-8763-f039b329d44e tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.103s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:05 user nova-compute[70645]: INFO nova.virt.block_device [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Attempting to driver detach volume 2078a518-214e-4029-b820-fb393e0e884d from mountpoint /dev/vdb
Jul 24 14:57:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Attempting to detach device vdb from instance ff0bb392-a296-45a0-a102-f8b0e1c9d41a from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 14:57:05 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:57:05 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 14:57:05 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:57:05 user nova-compute[70645]:   <serial>2078a518-214e-4029-b820-fb393e0e884d</serial>
Jul 24 14:57:05 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 14:57:05 user nova-compute[70645]: </disk>
Jul 24 14:57:05 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:57:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Successfully detached device vdb from instance ff0bb392-a296-45a0-a102-f8b0e1c9d41a from the persistent domain config.
Jul 24 14:57:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff0bb392-a296-45a0-a102-f8b0e1c9d41a from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 14:57:05 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:57:05 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 14:57:05 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:57:05 user nova-compute[70645]:   <serial>2078a518-214e-4029-b820-fb393e0e884d</serial>
Jul 24 14:57:05 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 14:57:05 user nova-compute[70645]: </disk>
Jul 24 14:57:05 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690210625.5210445, ff0bb392-a296-45a0-a102-f8b0e1c9d41a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff0bb392-a296-45a0-a102-f8b0e1c9d41a {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 14:57:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Successfully detached device vdb from instance ff0bb392-a296-45a0-a102-f8b0e1c9d41a from the live domain config.
Jul 24 14:57:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJReXVFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:57:05 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[131231cc-d250-4ab1-8607-825c4bd7c7a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7978f88-0cf6-44fd-8090-14be354b7975]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:57:05 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:57:05 user nova-compute[70645]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d (non-flash)
Jul 24 14:57:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:57:05 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:57:05 user nova-compute[70645]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d (non-flash)
Jul 24 14:57:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba842a3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfa6063-370b-44f4-ad18-370a4c0ba4fd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eff9d11-814d-4238-a342-7de7af924893]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48ab073-c967-498e-8872-2b50ff921639]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75cbcea-1b5a-4fd6-b57b-3188e725525d]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4df923b-eb06-41ce-bee1-39c69cca905a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[82930270-4316-4af2-939d-133f18d9390d]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d, portal: 172.16.0.220,3260]
Jul 24 14:57:05 user nova-compute[70645]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d, portal: 172.16.0.220,3260] successful.
Jul 24 14:57:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2078a518-214e-4029-b820-fb393e0e884d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f364bb-62f3-43e9-ac6e-2a27ed33fa9b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] <== disconnect_volume: return (295ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:57:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:57:06 user nova-compute[70645]: DEBUG nova.objects.instance [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lazy-loading 'flavor' on Instance uuid ff0bb392-a296-45a0-a102-f8b0e1c9d41a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-96f303b8-a986-4cfe-86a4-9b66e04f8589 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.732s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:09 user nova-compute[70645]: INFO nova.compute.manager [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Rescuing
Jul 24 14:57:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:57:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquired lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:57:09 user nova-compute[70645]: DEBUG nova.network.neutron [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:57:10 user nova-compute[70645]: DEBUG nova.network.neutron [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Updating instance_info_cache with network_info: [{"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:57:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Releasing lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:57:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:11 user nova-compute[70645]: DEBUG nova.compute.manager [req-74a42566-6a6e-491f-83f5-5c89426ee859 req-2027299e-b8c0-4ffd-94e1-50facc71b61d service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-unplugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-74a42566-6a6e-491f-83f5-5c89426ee859 req-2027299e-b8c0-4ffd-94e1-50facc71b61d service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-74a42566-6a6e-491f-83f5-5c89426ee859 req-2027299e-b8c0-4ffd-94e1-50facc71b61d service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-74a42566-6a6e-491f-83f5-5c89426ee859 req-2027299e-b8c0-4ffd-94e1-50facc71b61d service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:11 user nova-compute[70645]: DEBUG nova.compute.manager [req-74a42566-6a6e-491f-83f5-5c89426ee859 req-2027299e-b8c0-4ffd-94e1-50facc71b61d service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-unplugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:11 user nova-compute[70645]: WARNING nova.compute.manager [req-74a42566-6a6e-491f-83f5-5c89426ee859 req-2027299e-b8c0-4ffd-94e1-50facc71b61d service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received unexpected event network-vif-unplugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with vm_state active and task_state rescuing.
Jul 24 14:57:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Instance destroyed successfully.
Jul 24 14:57:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Attempting a stable device rescue
Jul 24 14:57:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70645) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 14:57:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Instance directory exists: not creating {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 14:57:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Creating image(s)
Jul 24 14:57:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "/opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "/opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "/opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:11 user nova-compute[70645]: DEBUG nova.objects.instance [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'trusted_certs' on Instance uuid 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "f641da8046782a4db0a3bca2f3711c16562a96c2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "f641da8046782a4db0a3bca2f3711c16562a96c2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2.part --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2.part --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:12 user nova-compute[70645]: DEBUG nova.virt.images [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] 15ccb866-a036-4cd8-a235-dab349dae73d was qcow2, converting to raw {{(pid=70645) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 14:57:12 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 14:57:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2.part /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2.converted {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.compute.manager [req-63a6075c-cb2d-4487-8d67-896c7ab8b186 req-faf8d170-3ebd-43fe-bfe6-d34939e5eb09 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-63a6075c-cb2d-4487-8d67-896c7ab8b186 req-faf8d170-3ebd-43fe-bfe6-d34939e5eb09 service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-63a6075c-cb2d-4487-8d67-896c7ab8b186 req-faf8d170-3ebd-43fe-bfe6-d34939e5eb09 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-63a6075c-cb2d-4487-8d67-896c7ab8b186 req-faf8d170-3ebd-43fe-bfe6-d34939e5eb09 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.compute.manager [req-63a6075c-cb2d-4487-8d67-896c7ab8b186 req-faf8d170-3ebd-43fe-bfe6-d34939e5eb09 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:13 user nova-compute[70645]: WARNING nova.compute.manager [req-63a6075c-cb2d-4487-8d67-896c7ab8b186 req-faf8d170-3ebd-43fe-bfe6-d34939e5eb09 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received unexpected event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with vm_state active and task_state rescuing.
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2.part /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2.converted" returned: 0 in 0.687s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2.converted --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2.converted --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "f641da8046782a4db0a3bca2f3711c16562a96c2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.219s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "f641da8046782a4db0a3bca2f3711c16562a96c2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "f641da8046782a4db0a3bca2f3711c16562a96c2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2 --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2 --force-share --output=json" returned: 0 in 0.155s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2,backing_fmt=raw /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.rescue {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2,backing_fmt=raw /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.rescue" returned: 0 in 0.076s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "f641da8046782a4db0a3bca2f3711c16562a96c2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.objects.instance [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'migration_context' on Instance uuid 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Start _get_guest_xml network_info=[{"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "vif_mac": "fa:16:3e:a2:0f:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '15ccb866-a036-4cd8-a235-dab349dae73d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fc0a4a79-e5ec-4d5d-9c74-2b2cc84f8d65', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROnGTIAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '10b586d2-6bff-4cb5-bde5-b8fdc035ff07', 'attached_at': '', 'detached_at': '', 'volume_id': 'a968748b-0bec-460a-bb02-bc7d4774f0c3', 'serial': 'a968748b-0bec-460a-bb02-bc7d4774f0c3'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.objects.instance [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'resources' on Instance uuid 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.objects.instance [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'numa_topology' on Instance uuid 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:13 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:13 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.objects.instance [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'vcpu_model' on Instance uuid 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROnGTIAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:57:13 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:57:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:57:13 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:57:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:57:13 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[05978675-f647-4c95-a2b5-247e32fcbaaf]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ROnGTIAe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 24 14:57:13 user nova-compute[70645]: node.name = iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3
Jul 24 14:57:13 user nova-compute[70645]: node.tpgt = -1
Jul 24 14:57:13 user nova-compute[70645]: node.startup = automatic
Jul 24 14:57:13 user nova-compute[70645]: node.leading_login = No
Jul 24 14:57:13 user nova-compute[70645]: iface.iscsi_ifacename = default
Jul 24 14:57:13 user nova-compute[70645]: iface.net_ifacename = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.ipaddress = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.prefix_len = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.hwaddress = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.transport_name = tcp
Jul 24 14:57:13 user nova-compute[70645]: iface.initiatorname = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.state = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.vlan_id = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.vlan_priority = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.vlan_state = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.iface_num = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.mtu = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.port = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.bootproto = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.subnet_mask = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.gateway = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.dhcp_alt_client_id_state = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.dhcp_alt_client_id = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.dhcp_dns = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.dhcp_learn_iqn = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.dhcp_req_vendor_id_state = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.dhcp_vendor_id_state = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.dhcp_vendor_id = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.dhcp_slp_da = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.fragmentation = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.gratuitous_arp = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.incoming_forwarding = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.tos_state = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.tos = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.ttl = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.delayed_ack = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.tcp_nagle = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.tcp_wsf_state = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.tcp_wsf = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.tcp_timer_scale = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.tcp_timestamp = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.redirect = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.def_task_mgmt_timeout = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.header_digest = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.data_digest = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.immediate_data = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.initial_r2t = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.data_seq_inorder = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.data_pdu_inorder = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.erl = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.max_receive_data_len = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.first_burst_len = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.max_outstanding_r2t = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.max_burst_len = 0
Jul 24 14:57:13 user nova-compute[70645]: iface.chap_auth = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.bidi_chap = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.strict_login_compliance = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.discovery_auth = <empty>
Jul 24 14:57:13 user nova-compute[70645]: iface.discovery_logout = <empty>
Jul 24 14:57:13 user nova-compute[70645]: node.discovery_address = <empty>
Jul 24 14:57:13 user nova-compute[70645]: node.discovery_port = 0
Jul 24 14:57:13 user nova-compute[70645]: node.discovery_type = static
Jul 24 14:57:13 user nova-compute[70645]: node.session.initial_cmdsn = 0
Jul 24 14:57:13 user nova-compute[70645]: node.session.initial_login_retry_max = 8
Jul 24 14:57:13 user nova-compute[70645]: node.session.xmit_thread_priority = -20
Jul 24 14:57:13 user nova-compute[70645]: node.session.cmds_max = 128
Jul 24 14:57:13 user nova-compute[70645]: node.session.queue_depth = 32
Jul 24 14:57:13 user nova-compute[70645]: node.session.nr_sessions = 1
Jul 24 14:57:13 user nova-compute[70645]: node.session.auth.authmethod = CHAP
Jul 24 14:57:13 user nova-compute[70645]: node.session.auth.username = ROnGTIAe
Jul 24 14:57:13 user nova-compute[70645]: node.session.auth.password = ***
Jul 24 14:57:13 user nova-compute[70645]: node.session.auth.username_in = <empty>
Jul 24 14:57:13 user nova-compute[70645]: node.session.auth.password_in = <empty>
Jul 24 14:57:13 user nova-compute[70645]: node.session.auth.chap_algs = MD5
Jul 24 14:57:13 user nova-compute[70645]: node.session.timeo.replacement_timeout = 120
Jul 24 14:57:13 user nova-compute[70645]: node.session.err_timeo.abort_timeout = 15
Jul 24 14:57:13 user nova-compute[70645]: node.session.err_timeo.lu_reset_timeout = 30
Jul 24 14:57:13 user nova-compute[70645]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 24 14:57:13 user nova-compute[70645]: node.session.err_timeo.host_reset_timeout = 60
Jul 24 14:57:13 user nova-compute[70645]: node.session.iscsi.FastAbort = Yes
Jul 24 14:57:13 user nova-compute[70645]: node.session.iscsi.InitialR2T = No
Jul 24 14:57:13 user nova-compute[70645]: node.session.iscsi.ImmediateData = Yes
Jul 24 14:57:13 user nova-compute[70645]: node.session.iscsi.FirstBurstLength = 262144
Jul 24 14:57:13 user nova-compute[70645]: node.session.iscsi.MaxBurstLength = 16776192
Jul 24 14:57:13 user nova-compute[70645]: node.session.iscsi.DefaultTime2Retain = 0
Jul 24 14:57:13 user nova-compute[70645]: node.session.iscsi.DefaultTime2Wait = 2
Jul 24 14:57:13 user nova-compute[70645]: node.session.iscsi.MaxConnections = 1
Jul 24 14:57:13 user nova-compute[70645]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 24 14:57:13 user nova-compute[70645]: node.session.iscsi.ERL = 0
Jul 24 14:57:13 user nova-compute[70645]: node.session.scan = manual
Jul 24 14:57:13 user nova-compute[70645]: node.session.reopen_max = 0
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].address = 172.16.0.220
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].port = 3260
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].startup = manual
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].tcp.window_size = 524288
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].tcp.type_of_service = 0
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].timeo.logout_timeout = 15
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].timeo.login_timeout = 15
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].timeo.auth_timeout = 45
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].timeo.noop_out_interval = 5
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].timeo.noop_out_timeout = 5
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].iscsi.HeaderDigest = None
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].iscsi.DataDigest = None
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].iscsi.IFMarker = No
Jul 24 14:57:13 user nova-compute[70645]: node.conn[0].iscsi.OFMarker = No
Jul 24 14:57:13 user nova-compute[70645]: # END RECORD
Jul 24 14:57:13 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef6723a-807d-482b-9486-2d35edf2aecb]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b249ce-80f1-447f-91ad-2423a16fa80d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ROnGTIAe {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ROnGTIAe" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c955ae3-178a-4501-94c2-55d826633cea]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ROnGTIAe'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[da481f15-49f9-4b0e-879d-e6f1ba7e62a0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5af6908-5f15-4c0d-9868-1ac2d4b5e697]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:57:14 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:57:14 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:57:14 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:57:14 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] HCTL ('42', '0', '0', 0) found on session 16 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Scanning host 42 c: 0, t: 0, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[338b5c73-498a-4474-b2c8-b8c51e66ecd5]: (4, ('0 0 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching for a device in session 16 and hctl ('42', '0', '0', 0) yield: sdk {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROnGTIAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.199s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] <== connect_volume: return (200ms) {'type': 'block', 'scsi_wwn': '26134343735393166', 'path': '/dev/sdk'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134343735393166', 'path': '/dev/sdk'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1295668391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1295668391',id=13,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:55:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-fe9sxf4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:55:39Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=10b586d2-6bff-4cb5-bde5-b8fdc035ff07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "vif_mac": "fa:16:3e:a2:0f:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "vif_mac": "fa:16:3e:a2:0f:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:0f:85,bridge_name='br-int',has_traffic_filtering=True,id=376b3d27-e524-41f9-916f-1a3901da8eec,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376b3d27-e5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG nova.objects.instance [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'pci_devices' on Instance uuid 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:57:14 user nova-compute[70645]:   <uuid>10b586d2-6bff-4cb5-bde5-b8fdc035ff07</uuid>
Jul 24 14:57:14 user nova-compute[70645]:   <name>instance-0000000d</name>
Jul 24 14:57:14 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:57:14 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:57:14 user nova-compute[70645]:   <metadata>
Jul 24 14:57:14 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:57:14 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:57:14 user nova-compute[70645]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1295668391</nova:name>
Jul 24 14:57:14 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:57:13</nova:creationTime>
Jul 24 14:57:14 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:57:14 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:57:14 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:57:14 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:57:14 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:57:14 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:57:14 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:57:14 user nova-compute[70645]:       <nova:owner>
Jul 24 14:57:14 user nova-compute[70645]:         <nova:user uuid="192b7bd8dd234dceadc22ba7bb092344">tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member</nova:user>
Jul 24 14:57:14 user nova-compute[70645]:         <nova:project uuid="bab8baa391424072ba5bcea7f54f0242">tempest-ServerBootFromVolumeStableRescueTest-1550895590</nova:project>
Jul 24 14:57:14 user nova-compute[70645]:       </nova:owner>
Jul 24 14:57:14 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:57:14 user nova-compute[70645]:       <nova:ports>
Jul 24 14:57:14 user nova-compute[70645]:         <nova:port uuid="376b3d27-e524-41f9-916f-1a3901da8eec">
Jul 24 14:57:14 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 14:57:14 user nova-compute[70645]:         </nova:port>
Jul 24 14:57:14 user nova-compute[70645]:       </nova:ports>
Jul 24 14:57:14 user nova-compute[70645]:     </nova:instance>
Jul 24 14:57:14 user nova-compute[70645]:   </metadata>
Jul 24 14:57:14 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:57:14 user nova-compute[70645]:     <system>
Jul 24 14:57:14 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:57:14 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:57:14 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:57:14 user nova-compute[70645]:       <entry name="serial">10b586d2-6bff-4cb5-bde5-b8fdc035ff07</entry>
Jul 24 14:57:14 user nova-compute[70645]:       <entry name="uuid">10b586d2-6bff-4cb5-bde5-b8fdc035ff07</entry>
Jul 24 14:57:14 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:57:14 user nova-compute[70645]:     </system>
Jul 24 14:57:14 user nova-compute[70645]:   </sysinfo>
Jul 24 14:57:14 user nova-compute[70645]:   <os>
Jul 24 14:57:14 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:57:14 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:57:14 user nova-compute[70645]:   </os>
Jul 24 14:57:14 user nova-compute[70645]:   <features>
Jul 24 14:57:14 user nova-compute[70645]:     <acpi/>
Jul 24 14:57:14 user nova-compute[70645]:     <apic/>
Jul 24 14:57:14 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:57:14 user nova-compute[70645]:   </features>
Jul 24 14:57:14 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:57:14 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:57:14 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:57:14 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:57:14 user nova-compute[70645]:   </clock>
Jul 24 14:57:14 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:57:14 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:57:14 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:57:14 user nova-compute[70645]:   </cpu>
Jul 24 14:57:14 user nova-compute[70645]:   <devices>
Jul 24 14:57:14 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 14:57:14 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:57:14 user nova-compute[70645]:       <source dev="/dev/sdk"/>
Jul 24 14:57:14 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:57:14 user nova-compute[70645]:       <serial>a968748b-0bec-460a-bb02-bc7d4774f0c3</serial>
Jul 24 14:57:14 user nova-compute[70645]:     </disk>
Jul 24 14:57:14 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:57:14 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:57:14 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.rescue"/>
Jul 24 14:57:14 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 14:57:14 user nova-compute[70645]:       <boot order="1"/>
Jul 24 14:57:14 user nova-compute[70645]:     </disk>
Jul 24 14:57:14 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:57:14 user nova-compute[70645]:       <mac address="fa:16:3e:a2:0f:85"/>
Jul 24 14:57:14 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:14 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:57:14 user nova-compute[70645]:       <target dev="tap376b3d27-e5"/>
Jul 24 14:57:14 user nova-compute[70645]:     </interface>
Jul 24 14:57:14 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:57:14 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/console.log" append="off"/>
Jul 24 14:57:14 user nova-compute[70645]:     </serial>
Jul 24 14:57:14 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:57:14 user nova-compute[70645]:     <video>
Jul 24 14:57:14 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:14 user nova-compute[70645]:     </video>
Jul 24 14:57:14 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:57:14 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:57:14 user nova-compute[70645]:     </rng>
Jul 24 14:57:14 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:57:14 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:57:14 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:57:14 user nova-compute[70645]:     </memballoon>
Jul 24 14:57:14 user nova-compute[70645]:   </devices>
Jul 24 14:57:14 user nova-compute[70645]: </domain>
Jul 24 14:57:14 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:57:14 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Instance destroyed successfully.
Jul 24 14:57:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No VIF found with MAC fa:16:3e:a2:0f:85, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:14 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:57:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:15 user nova-compute[70645]: DEBUG nova.compute.manager [req-f75f493d-1a66-473a-a04a-60466e24172b req-5c56c99c-31c9-474e-9c6e-cbc84e715c4b service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f75f493d-1a66-473a-a04a-60466e24172b req-5c56c99c-31c9-474e-9c6e-cbc84e715c4b service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f75f493d-1a66-473a-a04a-60466e24172b req-5c56c99c-31c9-474e-9c6e-cbc84e715c4b service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f75f493d-1a66-473a-a04a-60466e24172b req-5c56c99c-31c9-474e-9c6e-cbc84e715c4b service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:15 user nova-compute[70645]: DEBUG nova.compute.manager [req-f75f493d-1a66-473a-a04a-60466e24172b req-5c56c99c-31c9-474e-9c6e-cbc84e715c4b service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:15 user nova-compute[70645]: WARNING nova.compute.manager [req-f75f493d-1a66-473a-a04a-60466e24172b req-5c56c99c-31c9-474e-9c6e-cbc84e715c4b service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received unexpected event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with vm_state active and task_state rescuing.
Jul 24 14:57:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:57:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210637.8701994, 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:57:17 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] VM Resumed (Lifecycle Event)
Jul 24 14:57:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-55cc1063-fd8a-439d-9b46-a9d7c08c322c tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG nova.compute.manager [req-9e8ee84c-4dba-4ace-9786-e5c85bdc6cb9 req-2d8c38a0-548a-4177-aa4f-66289a433d91 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9e8ee84c-4dba-4ace-9786-e5c85bdc6cb9 req-2d8c38a0-548a-4177-aa4f-66289a433d91 service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9e8ee84c-4dba-4ace-9786-e5c85bdc6cb9 req-2d8c38a0-548a-4177-aa4f-66289a433d91 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9e8ee84c-4dba-4ace-9786-e5c85bdc6cb9 req-2d8c38a0-548a-4177-aa4f-66289a433d91 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:17 user nova-compute[70645]: DEBUG nova.compute.manager [req-9e8ee84c-4dba-4ace-9786-e5c85bdc6cb9 req-2d8c38a0-548a-4177-aa4f-66289a433d91 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:17 user nova-compute[70645]: WARNING nova.compute.manager [req-9e8ee84c-4dba-4ace-9786-e5c85bdc6cb9 req-2d8c38a0-548a-4177-aa4f-66289a433d91 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received unexpected event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with vm_state active and task_state rescuing.
Jul 24 14:57:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210637.887354, 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:57:18 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] VM Started (Lifecycle Event)
Jul 24 14:57:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:19 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:19 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7496MB free_disk=25.657180786132812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 046adfbd-fa5f-45f5-ae62-ddc0f834d450 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance f1a667e2-7992-44e4-9500-fa598493e173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance dd796d18-9a13-40b8-9f4e-0a9dd93d4149 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance ff0bb392-a296-45a0-a102-f8b0e1c9d41a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 460ae655-2955-4a45-9b12-2a3ddd9f448b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance dae4da41-53a6-44a5-bd36-90b9f6bb828d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:57:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:57:20 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:57:20 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:57:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:57:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:21 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:57:21 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 14:57:21 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 14:57:21 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:57:21 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:57:21 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:57:21 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:57:21 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:57:22 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:57:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:57:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:28 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:57:28 user nova-compute[70645]: INFO nova.compute.claims [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Claim successful on node user
Jul 24 14:57:29 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG nova.network.neutron [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:57:29 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:57:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:57:29 user nova-compute[70645]: INFO nova.compute.claims [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Claim successful on node user
Jul 24 14:57:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:57:29 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Creating image(s)
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "/opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "/opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG nova.policy [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1adea3e2d58a473b9f7f40a21f7c7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c90b1c32384354a8ba5140a846be6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk 1073741824" returned: 0 in 0.056s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.766s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Cannot resize image /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.objects.instance [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'migration_context' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Ensure instance console log exists: /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:57:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.policy [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b715d50164af4254aecf7156d617fa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68682834554049928782963eab8ea32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Successfully created port: 02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:57:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Creating image(s)
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "/opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "/opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "/opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.130s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk 1073741824" returned: 0 in 0.059s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:57:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Cannot resize image /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lazy-loading 'migration_context' on Instance uuid 293709a6-cd86-4153-9a9c-a7bc05fc65fb {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Ensure instance console log exists: /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Successfully created port: b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Successfully updated port: 02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquired lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-8ee70364-1601-4d86-a74b-127813b8537e req-57cd4e0d-ac00-4980-9583-2142b8d947eb service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-changed-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-8ee70364-1601-4d86-a74b-127813b8537e req-57cd4e0d-ac00-4980-9583-2142b8d947eb service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Refreshing instance network info cache due to event network-changed-02ca6838-89e2-41bc-a858-dc7a007f7960. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8ee70364-1601-4d86-a74b-127813b8537e req-57cd4e0d-ac00-4980-9583-2142b8d947eb service nova] Acquiring lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updating instance_info_cache with network_info: [{"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Releasing lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Instance network_info: |[{"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8ee70364-1601-4d86-a74b-127813b8537e req-57cd4e0d-ac00-4980-9583-2142b8d947eb service nova] Acquired lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.network.neutron [req-8ee70364-1601-4d86-a74b-127813b8537e req-57cd4e0d-ac00-4980-9583-2142b8d947eb service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Refreshing network info cache for port 02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Start _get_guest_xml network_info=[{"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:57:31 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:31 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1233785489',display_name='tempest-ServerStableDeviceRescueTest-server-1233785489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1233785489',id=17,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXs5WJpPEztU3bfcQKgE/HpXK8WmqpvoWAYUQl0M18pIkCkgsIYQ1MmCYCpsMYDnyC9pUZ7q7T6GsoqZ5+Vq8EmW7X8NdZgpv4sxbNieOyY+y5vMm+LYNVL7UXtGRhQFA==',key_name='tempest-keypair-115789889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c90b1c32384354a8ba5140a846be6f',ramdisk_id='',reservation_id='r-1w9tjbeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-494685022',owner_user_name='tempest-ServerStableDeviceRescueTest-494685022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:57:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1adea3e2d58a473b9f7f40a21f7c7bea',uuid=6fafa215-3ee5-4efb-816a-1d9f72e667da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Converting VIF {"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:be:ca,bridge_name='br-int',has_traffic_filtering=True,id=02ca6838-89e2-41bc-a858-dc7a007f7960,network=Network(c2cb753b-9202-48c0-923f-2a9713209b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ca6838-89') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:57:31 user nova-compute[70645]:   <uuid>6fafa215-3ee5-4efb-816a-1d9f72e667da</uuid>
Jul 24 14:57:31 user nova-compute[70645]:   <name>instance-00000011</name>
Jul 24 14:57:31 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:57:31 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:57:31 user nova-compute[70645]:   <metadata>
Jul 24 14:57:31 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:57:31 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:57:31 user nova-compute[70645]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1233785489</nova:name>
Jul 24 14:57:31 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:57:31</nova:creationTime>
Jul 24 14:57:31 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:57:31 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:57:31 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:57:31 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:57:31 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:57:31 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:57:31 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:57:31 user nova-compute[70645]:       <nova:owner>
Jul 24 14:57:31 user nova-compute[70645]:         <nova:user uuid="1adea3e2d58a473b9f7f40a21f7c7bea">tempest-ServerStableDeviceRescueTest-494685022-project-member</nova:user>
Jul 24 14:57:31 user nova-compute[70645]:         <nova:project uuid="54c90b1c32384354a8ba5140a846be6f">tempest-ServerStableDeviceRescueTest-494685022</nova:project>
Jul 24 14:57:31 user nova-compute[70645]:       </nova:owner>
Jul 24 14:57:31 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:57:31 user nova-compute[70645]:       <nova:ports>
Jul 24 14:57:31 user nova-compute[70645]:         <nova:port uuid="02ca6838-89e2-41bc-a858-dc7a007f7960">
Jul 24 14:57:31 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 14:57:31 user nova-compute[70645]:         </nova:port>
Jul 24 14:57:31 user nova-compute[70645]:       </nova:ports>
Jul 24 14:57:31 user nova-compute[70645]:     </nova:instance>
Jul 24 14:57:31 user nova-compute[70645]:   </metadata>
Jul 24 14:57:31 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:57:31 user nova-compute[70645]:     <system>
Jul 24 14:57:31 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:57:31 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:57:31 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:57:31 user nova-compute[70645]:       <entry name="serial">6fafa215-3ee5-4efb-816a-1d9f72e667da</entry>
Jul 24 14:57:31 user nova-compute[70645]:       <entry name="uuid">6fafa215-3ee5-4efb-816a-1d9f72e667da</entry>
Jul 24 14:57:31 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:57:31 user nova-compute[70645]:     </system>
Jul 24 14:57:31 user nova-compute[70645]:   </sysinfo>
Jul 24 14:57:31 user nova-compute[70645]:   <os>
Jul 24 14:57:31 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:57:31 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:57:31 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:57:31 user nova-compute[70645]:   </os>
Jul 24 14:57:31 user nova-compute[70645]:   <features>
Jul 24 14:57:31 user nova-compute[70645]:     <acpi/>
Jul 24 14:57:31 user nova-compute[70645]:     <apic/>
Jul 24 14:57:31 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:57:31 user nova-compute[70645]:   </features>
Jul 24 14:57:31 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:57:31 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:57:31 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:57:31 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:57:31 user nova-compute[70645]:   </clock>
Jul 24 14:57:31 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:57:31 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:57:31 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:57:31 user nova-compute[70645]:   </cpu>
Jul 24 14:57:31 user nova-compute[70645]:   <devices>
Jul 24 14:57:31 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:57:31 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:57:31 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk"/>
Jul 24 14:57:31 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:57:31 user nova-compute[70645]:     </disk>
Jul 24 14:57:31 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:57:31 user nova-compute[70645]:       <mac address="fa:16:3e:5c:be:ca"/>
Jul 24 14:57:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:31 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:57:31 user nova-compute[70645]:       <target dev="tap02ca6838-89"/>
Jul 24 14:57:31 user nova-compute[70645]:     </interface>
Jul 24 14:57:31 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:57:31 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/console.log" append="off"/>
Jul 24 14:57:31 user nova-compute[70645]:     </serial>
Jul 24 14:57:31 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:57:31 user nova-compute[70645]:     <video>
Jul 24 14:57:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:31 user nova-compute[70645]:     </video>
Jul 24 14:57:31 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:57:31 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:57:31 user nova-compute[70645]:     </rng>
Jul 24 14:57:31 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:57:31 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:57:31 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:57:31 user nova-compute[70645]:     </memballoon>
Jul 24 14:57:31 user nova-compute[70645]:   </devices>
Jul 24 14:57:31 user nova-compute[70645]: </domain>
Jul 24 14:57:31 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1233785489',display_name='tempest-ServerStableDeviceRescueTest-server-1233785489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1233785489',id=17,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXs5WJpPEztU3bfcQKgE/HpXK8WmqpvoWAYUQl0M18pIkCkgsIYQ1MmCYCpsMYDnyC9pUZ7q7T6GsoqZ5+Vq8EmW7X8NdZgpv4sxbNieOyY+y5vMm+LYNVL7UXtGRhQFA==',key_name='tempest-keypair-115789889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c90b1c32384354a8ba5140a846be6f',ramdisk_id='',reservation_id='r-1w9tjbeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-494685022',owner_user_name='tempest-ServerStableDeviceRescueTest-494685022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:57:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1adea3e2d58a473b9f7f40a21f7c7bea',uuid=6fafa215-3ee5-4efb-816a-1d9f72e667da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Converting VIF {"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:be:ca,bridge_name='br-int',has_traffic_filtering=True,id=02ca6838-89e2-41bc-a858-dc7a007f7960,network=Network(c2cb753b-9202-48c0-923f-2a9713209b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ca6838-89') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG os_vif [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:be:ca,bridge_name='br-int',has_traffic_filtering=True,id=02ca6838-89e2-41bc-a858-dc7a007f7960,network=Network(c2cb753b-9202-48c0-923f-2a9713209b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ca6838-89') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02ca6838-89, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02ca6838-89, col_values=(('external_ids', {'iface-id': '02ca6838-89e2-41bc-a858-dc7a007f7960', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:be:ca', 'vm-uuid': '6fafa215-3ee5-4efb-816a-1d9f72e667da'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:31 user nova-compute[70645]: INFO os_vif [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:be:ca,bridge_name='br-int',has_traffic_filtering=True,id=02ca6838-89e2-41bc-a858-dc7a007f7960,network=Network(c2cb753b-9202-48c0-923f-2a9713209b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ca6838-89')
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:57:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] No VIF found with MAC fa:16:3e:5c:be:ca, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG nova.network.neutron [req-8ee70364-1601-4d86-a74b-127813b8537e req-57cd4e0d-ac00-4980-9583-2142b8d947eb service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updated VIF entry in instance network info cache for port 02ca6838-89e2-41bc-a858-dc7a007f7960. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG nova.network.neutron [req-8ee70364-1601-4d86-a74b-127813b8537e req-57cd4e0d-ac00-4980-9583-2142b8d947eb service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updating instance_info_cache with network_info: [{"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8ee70364-1601-4d86-a74b-127813b8537e req-57cd4e0d-ac00-4980-9583-2142b8d947eb service nova] Releasing lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Successfully updated port: b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "refresh_cache-293709a6-cd86-4153-9a9c-a7bc05fc65fb" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquired lock "refresh_cache-293709a6-cd86-4153-9a9c-a7bc05fc65fb" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-5fb83fae-b484-44eb-8840-f48792c1e0ac req-28c408b3-a077-47cf-af5e-028009704ae1 service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Received event network-changed-b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-5fb83fae-b484-44eb-8840-f48792c1e0ac req-28c408b3-a077-47cf-af5e-028009704ae1 service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Refreshing instance network info cache due to event network-changed-b61c1912-d140-47c3-bb0c-09b73959bffb. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:57:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5fb83fae-b484-44eb-8840-f48792c1e0ac req-28c408b3-a077-47cf-af5e-028009704ae1 service nova] Acquiring lock "refresh_cache-293709a6-cd86-4153-9a9c-a7bc05fc65fb" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.network.neutron [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Updating instance_info_cache with network_info: [{"id": "b61c1912-d140-47c3-bb0c-09b73959bffb", "address": "fa:16:3e:8c:34:50", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61c1912-d1", "ovs_interfaceid": "b61c1912-d140-47c3-bb0c-09b73959bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Releasing lock "refresh_cache-293709a6-cd86-4153-9a9c-a7bc05fc65fb" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Instance network_info: |[{"id": "b61c1912-d140-47c3-bb0c-09b73959bffb", "address": "fa:16:3e:8c:34:50", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61c1912-d1", "ovs_interfaceid": "b61c1912-d140-47c3-bb0c-09b73959bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5fb83fae-b484-44eb-8840-f48792c1e0ac req-28c408b3-a077-47cf-af5e-028009704ae1 service nova] Acquired lock "refresh_cache-293709a6-cd86-4153-9a9c-a7bc05fc65fb" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.network.neutron [req-5fb83fae-b484-44eb-8840-f48792c1e0ac req-28c408b3-a077-47cf-af5e-028009704ae1 service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Refreshing network info cache for port b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Start _get_guest_xml network_info=[{"id": "b61c1912-d140-47c3-bb0c-09b73959bffb", "address": "fa:16:3e:8c:34:50", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61c1912-d1", "ovs_interfaceid": "b61c1912-d140-47c3-bb0c-09b73959bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:57:33 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:33 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1029059461',display_name='tempest-VolumesActionsTest-instance-1029059461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1029059461',id=18,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68682834554049928782963eab8ea32b',ramdisk_id='',reservation_id='r-x2g9rc72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1302908910',owner_user_name='tempest-VolumesActionsTest-1302908910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:57:30Z,user_data=None,user_id='b715d50164af4254aecf7156d617fa34',uuid=293709a6-cd86-4153-9a9c-a7bc05fc65fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b61c1912-d140-47c3-bb0c-09b73959bffb", "address": "fa:16:3e:8c:34:50", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61c1912-d1", "ovs_interfaceid": "b61c1912-d140-47c3-bb0c-09b73959bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converting VIF {"id": "b61c1912-d140-47c3-bb0c-09b73959bffb", "address": "fa:16:3e:8c:34:50", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61c1912-d1", "ovs_interfaceid": "b61c1912-d140-47c3-bb0c-09b73959bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:50,bridge_name='br-int',has_traffic_filtering=True,id=b61c1912-d140-47c3-bb0c-09b73959bffb,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61c1912-d1') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.objects.instance [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lazy-loading 'pci_devices' on Instance uuid 293709a6-cd86-4153-9a9c-a7bc05fc65fb {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:57:33 user nova-compute[70645]:   <uuid>293709a6-cd86-4153-9a9c-a7bc05fc65fb</uuid>
Jul 24 14:57:33 user nova-compute[70645]:   <name>instance-00000012</name>
Jul 24 14:57:33 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:57:33 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:57:33 user nova-compute[70645]:   <metadata>
Jul 24 14:57:33 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:57:33 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:57:33 user nova-compute[70645]:       <nova:name>tempest-VolumesActionsTest-instance-1029059461</nova:name>
Jul 24 14:57:33 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:57:33</nova:creationTime>
Jul 24 14:57:33 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:57:33 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:57:33 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:57:33 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:57:33 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:57:33 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:57:33 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:57:33 user nova-compute[70645]:       <nova:owner>
Jul 24 14:57:33 user nova-compute[70645]:         <nova:user uuid="b715d50164af4254aecf7156d617fa34">tempest-VolumesActionsTest-1302908910-project-member</nova:user>
Jul 24 14:57:33 user nova-compute[70645]:         <nova:project uuid="68682834554049928782963eab8ea32b">tempest-VolumesActionsTest-1302908910</nova:project>
Jul 24 14:57:33 user nova-compute[70645]:       </nova:owner>
Jul 24 14:57:33 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:57:33 user nova-compute[70645]:       <nova:ports>
Jul 24 14:57:33 user nova-compute[70645]:         <nova:port uuid="b61c1912-d140-47c3-bb0c-09b73959bffb">
Jul 24 14:57:33 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 14:57:33 user nova-compute[70645]:         </nova:port>
Jul 24 14:57:33 user nova-compute[70645]:       </nova:ports>
Jul 24 14:57:33 user nova-compute[70645]:     </nova:instance>
Jul 24 14:57:33 user nova-compute[70645]:   </metadata>
Jul 24 14:57:33 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:57:33 user nova-compute[70645]:     <system>
Jul 24 14:57:33 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:57:33 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:57:33 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:57:33 user nova-compute[70645]:       <entry name="serial">293709a6-cd86-4153-9a9c-a7bc05fc65fb</entry>
Jul 24 14:57:33 user nova-compute[70645]:       <entry name="uuid">293709a6-cd86-4153-9a9c-a7bc05fc65fb</entry>
Jul 24 14:57:33 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:57:33 user nova-compute[70645]:     </system>
Jul 24 14:57:33 user nova-compute[70645]:   </sysinfo>
Jul 24 14:57:33 user nova-compute[70645]:   <os>
Jul 24 14:57:33 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:57:33 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:57:33 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:57:33 user nova-compute[70645]:   </os>
Jul 24 14:57:33 user nova-compute[70645]:   <features>
Jul 24 14:57:33 user nova-compute[70645]:     <acpi/>
Jul 24 14:57:33 user nova-compute[70645]:     <apic/>
Jul 24 14:57:33 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:57:33 user nova-compute[70645]:   </features>
Jul 24 14:57:33 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:57:33 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:57:33 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:57:33 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:57:33 user nova-compute[70645]:   </clock>
Jul 24 14:57:33 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:57:33 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:57:33 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:57:33 user nova-compute[70645]:   </cpu>
Jul 24 14:57:33 user nova-compute[70645]:   <devices>
Jul 24 14:57:33 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:57:33 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:57:33 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk"/>
Jul 24 14:57:33 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:57:33 user nova-compute[70645]:     </disk>
Jul 24 14:57:33 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:57:33 user nova-compute[70645]:       <mac address="fa:16:3e:8c:34:50"/>
Jul 24 14:57:33 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:33 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:57:33 user nova-compute[70645]:       <target dev="tapb61c1912-d1"/>
Jul 24 14:57:33 user nova-compute[70645]:     </interface>
Jul 24 14:57:33 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:57:33 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/console.log" append="off"/>
Jul 24 14:57:33 user nova-compute[70645]:     </serial>
Jul 24 14:57:33 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:57:33 user nova-compute[70645]:     <video>
Jul 24 14:57:33 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:33 user nova-compute[70645]:     </video>
Jul 24 14:57:33 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:57:33 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:57:33 user nova-compute[70645]:     </rng>
Jul 24 14:57:33 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:57:33 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:57:33 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:57:33 user nova-compute[70645]:     </memballoon>
Jul 24 14:57:33 user nova-compute[70645]:   </devices>
Jul 24 14:57:33 user nova-compute[70645]: </domain>
Jul 24 14:57:33 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1029059461',display_name='tempest-VolumesActionsTest-instance-1029059461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1029059461',id=18,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68682834554049928782963eab8ea32b',ramdisk_id='',reservation_id='r-x2g9rc72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1302908910',owner_user_name='tempest-VolumesActionsTest-1302908910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:57:30Z,user_data=None,user_id='b715d50164af4254aecf7156d617fa34',uuid=293709a6-cd86-4153-9a9c-a7bc05fc65fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b61c1912-d140-47c3-bb0c-09b73959bffb", "address": "fa:16:3e:8c:34:50", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61c1912-d1", "ovs_interfaceid": "b61c1912-d140-47c3-bb0c-09b73959bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converting VIF {"id": "b61c1912-d140-47c3-bb0c-09b73959bffb", "address": "fa:16:3e:8c:34:50", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61c1912-d1", "ovs_interfaceid": "b61c1912-d140-47c3-bb0c-09b73959bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:50,bridge_name='br-int',has_traffic_filtering=True,id=b61c1912-d140-47c3-bb0c-09b73959bffb,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61c1912-d1') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG os_vif [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:50,bridge_name='br-int',has_traffic_filtering=True,id=b61c1912-d140-47c3-bb0c-09b73959bffb,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61c1912-d1') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb61c1912-d1, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb61c1912-d1, col_values=(('external_ids', {'iface-id': 'b61c1912-d140-47c3-bb0c-09b73959bffb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:34:50', 'vm-uuid': '293709a6-cd86-4153-9a9c-a7bc05fc65fb'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:33 user nova-compute[70645]: INFO os_vif [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:50,bridge_name='br-int',has_traffic_filtering=True,id=b61c1912-d140-47c3-bb0c-09b73959bffb,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61c1912-d1')
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] No VIF found with MAC fa:16:3e:8c:34:50, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-5fb83fae-b484-44eb-8840-f48792c1e0ac req-28c408b3-a077-47cf-af5e-028009704ae1 service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Updated VIF entry in instance network info cache for port b61c1912-d140-47c3-bb0c-09b73959bffb. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-5fb83fae-b484-44eb-8840-f48792c1e0ac req-28c408b3-a077-47cf-af5e-028009704ae1 service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Updating instance_info_cache with network_info: [{"id": "b61c1912-d140-47c3-bb0c-09b73959bffb", "address": "fa:16:3e:8c:34:50", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61c1912-d1", "ovs_interfaceid": "b61c1912-d140-47c3-bb0c-09b73959bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5fb83fae-b484-44eb-8840-f48792c1e0ac req-28c408b3-a077-47cf-af5e-028009704ae1 service nova] Releasing lock "refresh_cache-293709a6-cd86-4153-9a9c-a7bc05fc65fb" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-82bebe1c-9fe1-4810-89fb-5b1094be0deb req-f8dbfb81-0a3f-4eaf-bbd5-07724e5cf456 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-changed-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-82bebe1c-9fe1-4810-89fb-5b1094be0deb req-f8dbfb81-0a3f-4eaf-bbd5-07724e5cf456 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Refreshing instance network info cache due to event network-changed-3a56f8d6-1f50-46b0-949f-a64d933dd392. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-82bebe1c-9fe1-4810-89fb-5b1094be0deb req-f8dbfb81-0a3f-4eaf-bbd5-07724e5cf456 service nova] Acquiring lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-82bebe1c-9fe1-4810-89fb-5b1094be0deb req-f8dbfb81-0a3f-4eaf-bbd5-07724e5cf456 service nova] Acquired lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-82bebe1c-9fe1-4810-89fb-5b1094be0deb req-f8dbfb81-0a3f-4eaf-bbd5-07724e5cf456 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Refreshing network info cache for port 3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:34 user nova-compute[70645]: WARNING nova.compute.manager [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received unexpected event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with vm_state building and task_state spawning.
Jul 24 14:57:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:34 user nova-compute[70645]: WARNING nova.compute.manager [req-0269d27f-7f62-45d1-9e83-1bf36107ec9e req-80e97e10-3bf9-47d5-977d-1ff3ec427f6d service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received unexpected event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with vm_state building and task_state spawning.
Jul 24 14:57:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.network.neutron [req-82bebe1c-9fe1-4810-89fb-5b1094be0deb req-f8dbfb81-0a3f-4eaf-bbd5-07724e5cf456 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updated VIF entry in instance network info cache for port 3a56f8d6-1f50-46b0-949f-a64d933dd392. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.network.neutron [req-82bebe1c-9fe1-4810-89fb-5b1094be0deb req-f8dbfb81-0a3f-4eaf-bbd5-07724e5cf456 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating instance_info_cache with network_info: [{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-82bebe1c-9fe1-4810-89fb-5b1094be0deb req-f8dbfb81-0a3f-4eaf-bbd5-07724e5cf456 service nova] Releasing lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210655.629794, 6fafa215-3ee5-4efb-816a-1d9f72e667da => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:57:35 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] VM Resumed (Lifecycle Event)
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:57:35 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Instance spawned successfully.
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:57:35 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210655.6299608, 6fafa215-3ee5-4efb-816a-1d9f72e667da => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:57:35 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] VM Started (Lifecycle Event)
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:57:35 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-18389213-6bf2-4665-a55c-86d1132ef4b8 req-0a6f1957-7fd0-4aff-9ea8-24298dc06286 service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Received event network-vif-plugged-b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-18389213-6bf2-4665-a55c-86d1132ef4b8 req-0a6f1957-7fd0-4aff-9ea8-24298dc06286 service nova] Acquiring lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-18389213-6bf2-4665-a55c-86d1132ef4b8 req-0a6f1957-7fd0-4aff-9ea8-24298dc06286 service nova] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-18389213-6bf2-4665-a55c-86d1132ef4b8 req-0a6f1957-7fd0-4aff-9ea8-24298dc06286 service nova] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-18389213-6bf2-4665-a55c-86d1132ef4b8 req-0a6f1957-7fd0-4aff-9ea8-24298dc06286 service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] No waiting events found dispatching network-vif-plugged-b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:35 user nova-compute[70645]: WARNING nova.compute.manager [req-18389213-6bf2-4665-a55c-86d1132ef4b8 req-0a6f1957-7fd0-4aff-9ea8-24298dc06286 service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Received unexpected event network-vif-plugged-b61c1912-d140-47c3-bb0c-09b73959bffb for instance with vm_state building and task_state spawning.
Jul 24 14:57:35 user nova-compute[70645]: INFO nova.compute.manager [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Took 6.21 seconds to spawn the instance on the hypervisor.
Jul 24 14:57:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:35 user nova-compute[70645]: INFO nova.compute.manager [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Took 7.16 seconds to build instance.
Jul 24 14:57:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ab68ccdc-df50-49f0-a9b4-c43957685b49 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.266s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210657.7103126, 293709a6-cd86-4153-9a9c-a7bc05fc65fb => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:57:37 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] VM Resumed (Lifecycle Event)
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:57:37 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Instance spawned successfully.
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:57:37 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210657.7106805, 293709a6-cd86-4153-9a9c-a7bc05fc65fb => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:57:37 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] VM Started (Lifecycle Event)
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:57:37 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:57:37 user nova-compute[70645]: INFO nova.compute.manager [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Took 7.41 seconds to spawn the instance on the hypervisor.
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-72b2da45-4916-4167-ab1b-1f8395307e76 req-72243f3c-302a-4f81-bace-5d7d5e7428f3 service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Received event network-vif-plugged-b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-72b2da45-4916-4167-ab1b-1f8395307e76 req-72243f3c-302a-4f81-bace-5d7d5e7428f3 service nova] Acquiring lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-72b2da45-4916-4167-ab1b-1f8395307e76 req-72243f3c-302a-4f81-bace-5d7d5e7428f3 service nova] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-72b2da45-4916-4167-ab1b-1f8395307e76 req-72243f3c-302a-4f81-bace-5d7d5e7428f3 service nova] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-72b2da45-4916-4167-ab1b-1f8395307e76 req-72243f3c-302a-4f81-bace-5d7d5e7428f3 service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] No waiting events found dispatching network-vif-plugged-b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:37 user nova-compute[70645]: WARNING nova.compute.manager [req-72b2da45-4916-4167-ab1b-1f8395307e76 req-72243f3c-302a-4f81-bace-5d7d5e7428f3 service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Received unexpected event network-vif-plugged-b61c1912-d140-47c3-bb0c-09b73959bffb for instance with vm_state building and task_state spawning.
Jul 24 14:57:37 user nova-compute[70645]: INFO nova.compute.manager [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Took 8.56 seconds to build instance.
Jul 24 14:57:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-316bfe26-d373-488b-ab58-7bd1182edac0 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.684s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "74c53188-2399-4515-94e6-4ff3e94d7559" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:57:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:57:52 user nova-compute[70645]: INFO nova.compute.claims [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Claim successful on node user
Jul 24 14:57:53 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:57:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:57:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:57:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Creating image(s)
Jul 24 14:57:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "/opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG nova.policy [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74440f1d0cf141fdb6b40b0d1e3a5d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f8500e5a144902be74f12f3caf8ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk 1073741824" returned: 0 in 0.062s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.159s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "cf8bcde0-6825-45f0-85c3-14188211558c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Cannot resize image /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG nova.objects.instance [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'migration_context' on Instance uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Ensure instance console log exists: /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:57:54 user nova-compute[70645]: INFO nova.compute.claims [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Claim successful on node user
Jul 24 14:57:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Successfully created port: a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:57:54 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:57:55 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.policy [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74440f1d0cf141fdb6b40b0d1e3a5d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f8500e5a144902be74f12f3caf8ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:57:55 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Creating image(s)
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Successfully updated port: a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-03e7c203-83aa-46ad-94d9-ec1077816510 req-d00476bc-50b7-433c-bee3-71c9135a82a6 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-changed-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-03e7c203-83aa-46ad-94d9-ec1077816510 req-d00476bc-50b7-433c-bee3-71c9135a82a6 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Refreshing instance network info cache due to event network-changed-a4da7fd3-4861-41a6-ad8c-d9326d1b7160. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-03e7c203-83aa-46ad-94d9-ec1077816510 req-d00476bc-50b7-433c-bee3-71c9135a82a6 service nova] Acquiring lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-03e7c203-83aa-46ad-94d9-ec1077816510 req-d00476bc-50b7-433c-bee3-71c9135a82a6 service nova] Acquired lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-03e7c203-83aa-46ad-94d9-ec1077816510 req-d00476bc-50b7-433c-bee3-71c9135a82a6 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Refreshing network info cache for port a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-03e7c203-83aa-46ad-94d9-ec1077816510 req-d00476bc-50b7-433c-bee3-71c9135a82a6 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk 1073741824" returned: 0 in 0.053s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-03e7c203-83aa-46ad-94d9-ec1077816510 req-d00476bc-50b7-433c-bee3-71c9135a82a6 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-03e7c203-83aa-46ad-94d9-ec1077816510 req-d00476bc-50b7-433c-bee3-71c9135a82a6 service nova] Releasing lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquired lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Cannot resize image /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'migration_context' on Instance uuid cf8bcde0-6825-45f0-85c3-14188211558c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Ensure instance console log exists: /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Successfully created port: a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Updating instance_info_cache with network_info: [{"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Releasing lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Instance network_info: |[{"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Start _get_guest_xml network_info=[{"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:57:56 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:56 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998066313',display_name='tempest-ServerRescueNegativeTestJSON-server-998066313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998066313',id=19,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-8dcvtzzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:57:54Z,user_data=None,user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=74c53188-2399-4515-94e6-4ff3e94d7559,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=a4da7fd3-4861-41a6-ad8c-d9326d1b7160,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4da7fd3-48') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.objects.instance [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'pci_devices' on Instance uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:57:56 user nova-compute[70645]:   <uuid>74c53188-2399-4515-94e6-4ff3e94d7559</uuid>
Jul 24 14:57:56 user nova-compute[70645]:   <name>instance-00000013</name>
Jul 24 14:57:56 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:57:56 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:57:56 user nova-compute[70645]:   <metadata>
Jul 24 14:57:56 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:57:56 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:57:56 user nova-compute[70645]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-998066313</nova:name>
Jul 24 14:57:56 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:57:56</nova:creationTime>
Jul 24 14:57:56 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:57:56 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:57:56 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:57:56 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:57:56 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:57:56 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:57:56 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:57:56 user nova-compute[70645]:       <nova:owner>
Jul 24 14:57:56 user nova-compute[70645]:         <nova:user uuid="74440f1d0cf141fdb6b40b0d1e3a5d13">tempest-ServerRescueNegativeTestJSON-1652524619-project-member</nova:user>
Jul 24 14:57:56 user nova-compute[70645]:         <nova:project uuid="c3f8500e5a144902be74f12f3caf8ae2">tempest-ServerRescueNegativeTestJSON-1652524619</nova:project>
Jul 24 14:57:56 user nova-compute[70645]:       </nova:owner>
Jul 24 14:57:56 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:57:56 user nova-compute[70645]:       <nova:ports>
Jul 24 14:57:56 user nova-compute[70645]:         <nova:port uuid="a4da7fd3-4861-41a6-ad8c-d9326d1b7160">
Jul 24 14:57:56 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 14:57:56 user nova-compute[70645]:         </nova:port>
Jul 24 14:57:56 user nova-compute[70645]:       </nova:ports>
Jul 24 14:57:56 user nova-compute[70645]:     </nova:instance>
Jul 24 14:57:56 user nova-compute[70645]:   </metadata>
Jul 24 14:57:56 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:57:56 user nova-compute[70645]:     <system>
Jul 24 14:57:56 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:57:56 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:57:56 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:57:56 user nova-compute[70645]:       <entry name="serial">74c53188-2399-4515-94e6-4ff3e94d7559</entry>
Jul 24 14:57:56 user nova-compute[70645]:       <entry name="uuid">74c53188-2399-4515-94e6-4ff3e94d7559</entry>
Jul 24 14:57:56 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:57:56 user nova-compute[70645]:     </system>
Jul 24 14:57:56 user nova-compute[70645]:   </sysinfo>
Jul 24 14:57:56 user nova-compute[70645]:   <os>
Jul 24 14:57:56 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:57:56 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:57:56 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:57:56 user nova-compute[70645]:   </os>
Jul 24 14:57:56 user nova-compute[70645]:   <features>
Jul 24 14:57:56 user nova-compute[70645]:     <acpi/>
Jul 24 14:57:56 user nova-compute[70645]:     <apic/>
Jul 24 14:57:56 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:57:56 user nova-compute[70645]:   </features>
Jul 24 14:57:56 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:57:56 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:57:56 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:57:56 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:57:56 user nova-compute[70645]:   </clock>
Jul 24 14:57:56 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:57:56 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:57:56 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:57:56 user nova-compute[70645]:   </cpu>
Jul 24 14:57:56 user nova-compute[70645]:   <devices>
Jul 24 14:57:56 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:57:56 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:57:56 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk"/>
Jul 24 14:57:56 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:57:56 user nova-compute[70645]:     </disk>
Jul 24 14:57:56 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:57:56 user nova-compute[70645]:       <mac address="fa:16:3e:ae:bb:83"/>
Jul 24 14:57:56 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:56 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:57:56 user nova-compute[70645]:       <target dev="tapa4da7fd3-48"/>
Jul 24 14:57:56 user nova-compute[70645]:     </interface>
Jul 24 14:57:56 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:57:56 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/console.log" append="off"/>
Jul 24 14:57:56 user nova-compute[70645]:     </serial>
Jul 24 14:57:56 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:57:56 user nova-compute[70645]:     <video>
Jul 24 14:57:56 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:56 user nova-compute[70645]:     </video>
Jul 24 14:57:56 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:57:56 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:57:56 user nova-compute[70645]:     </rng>
Jul 24 14:57:56 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:57:56 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:57:56 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:57:56 user nova-compute[70645]:     </memballoon>
Jul 24 14:57:56 user nova-compute[70645]:   </devices>
Jul 24 14:57:56 user nova-compute[70645]: </domain>
Jul 24 14:57:56 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998066313',display_name='tempest-ServerRescueNegativeTestJSON-server-998066313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998066313',id=19,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-8dcvtzzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:57:54Z,user_data=None,user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=74c53188-2399-4515-94e6-4ff3e94d7559,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=a4da7fd3-4861-41a6-ad8c-d9326d1b7160,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4da7fd3-48') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG os_vif [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=a4da7fd3-4861-41a6-ad8c-d9326d1b7160,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4da7fd3-48') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4da7fd3-48, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4da7fd3-48, col_values=(('external_ids', {'iface-id': 'a4da7fd3-4861-41a6-ad8c-d9326d1b7160', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:bb:83', 'vm-uuid': '74c53188-2399-4515-94e6-4ff3e94d7559'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:56 user nova-compute[70645]: INFO os_vif [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=a4da7fd3-4861-41a6-ad8c-d9326d1b7160,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4da7fd3-48')
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:57:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No VIF found with MAC fa:16:3e:ae:bb:83, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:57:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Successfully updated port: a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:57:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:57:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquired lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:57:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:57:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-0f8443f1-18a7-42e5-9f9d-f48b73f26cba req-3655f87b-dc3e-43b6-9d5e-5bf6091ed8ee service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received event network-changed-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-0f8443f1-18a7-42e5-9f9d-f48b73f26cba req-3655f87b-dc3e-43b6-9d5e-5bf6091ed8ee service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Refreshing instance network info cache due to event network-changed-a192fa1c-1413-4f9a-bb16-8fd758373ce9. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:57:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0f8443f1-18a7-42e5-9f9d-f48b73f26cba req-3655f87b-dc3e-43b6-9d5e-5bf6091ed8ee service nova] Acquiring lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:57:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Updating instance_info_cache with network_info: [{"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Releasing lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Instance network_info: |[{"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0f8443f1-18a7-42e5-9f9d-f48b73f26cba req-3655f87b-dc3e-43b6-9d5e-5bf6091ed8ee service nova] Acquired lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.network.neutron [req-0f8443f1-18a7-42e5-9f9d-f48b73f26cba req-3655f87b-dc3e-43b6-9d5e-5bf6091ed8ee service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Refreshing network info cache for port a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Start _get_guest_xml network_info=[{"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:57:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-999275839',display_name='tempest-ServerRescueNegativeTestJSON-server-999275839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-999275839',id=20,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-wjnojzx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:57:55Z,user_data=None,user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=cf8bcde0-6825-45f0-85c3-14188211558c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f0:91,bridge_name='br-int',has_traffic_filtering=True,id=a192fa1c-1413-4f9a-bb16-8fd758373ce9,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa192fa1c-14') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'pci_devices' on Instance uuid cf8bcde0-6825-45f0-85c3-14188211558c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:57:58 user nova-compute[70645]:   <uuid>cf8bcde0-6825-45f0-85c3-14188211558c</uuid>
Jul 24 14:57:58 user nova-compute[70645]:   <name>instance-00000014</name>
Jul 24 14:57:58 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:57:58 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:57:58 user nova-compute[70645]:   <metadata>
Jul 24 14:57:58 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:57:58 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:57:58 user nova-compute[70645]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-999275839</nova:name>
Jul 24 14:57:58 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:57:58</nova:creationTime>
Jul 24 14:57:58 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:57:58 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:57:58 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:57:58 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:57:58 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:57:58 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:57:58 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:57:58 user nova-compute[70645]:       <nova:owner>
Jul 24 14:57:58 user nova-compute[70645]:         <nova:user uuid="74440f1d0cf141fdb6b40b0d1e3a5d13">tempest-ServerRescueNegativeTestJSON-1652524619-project-member</nova:user>
Jul 24 14:57:58 user nova-compute[70645]:         <nova:project uuid="c3f8500e5a144902be74f12f3caf8ae2">tempest-ServerRescueNegativeTestJSON-1652524619</nova:project>
Jul 24 14:57:58 user nova-compute[70645]:       </nova:owner>
Jul 24 14:57:58 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:57:58 user nova-compute[70645]:       <nova:ports>
Jul 24 14:57:58 user nova-compute[70645]:         <nova:port uuid="a192fa1c-1413-4f9a-bb16-8fd758373ce9">
Jul 24 14:57:58 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 14:57:58 user nova-compute[70645]:         </nova:port>
Jul 24 14:57:58 user nova-compute[70645]:       </nova:ports>
Jul 24 14:57:58 user nova-compute[70645]:     </nova:instance>
Jul 24 14:57:58 user nova-compute[70645]:   </metadata>
Jul 24 14:57:58 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:57:58 user nova-compute[70645]:     <system>
Jul 24 14:57:58 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:57:58 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:57:58 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:57:58 user nova-compute[70645]:       <entry name="serial">cf8bcde0-6825-45f0-85c3-14188211558c</entry>
Jul 24 14:57:58 user nova-compute[70645]:       <entry name="uuid">cf8bcde0-6825-45f0-85c3-14188211558c</entry>
Jul 24 14:57:58 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:57:58 user nova-compute[70645]:     </system>
Jul 24 14:57:58 user nova-compute[70645]:   </sysinfo>
Jul 24 14:57:58 user nova-compute[70645]:   <os>
Jul 24 14:57:58 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:57:58 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:57:58 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:57:58 user nova-compute[70645]:   </os>
Jul 24 14:57:58 user nova-compute[70645]:   <features>
Jul 24 14:57:58 user nova-compute[70645]:     <acpi/>
Jul 24 14:57:58 user nova-compute[70645]:     <apic/>
Jul 24 14:57:58 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:57:58 user nova-compute[70645]:   </features>
Jul 24 14:57:58 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:57:58 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:57:58 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:57:58 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:57:58 user nova-compute[70645]:   </clock>
Jul 24 14:57:58 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:57:58 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:57:58 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:57:58 user nova-compute[70645]:   </cpu>
Jul 24 14:57:58 user nova-compute[70645]:   <devices>
Jul 24 14:57:58 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:57:58 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:57:58 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk"/>
Jul 24 14:57:58 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:57:58 user nova-compute[70645]:     </disk>
Jul 24 14:57:58 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:57:58 user nova-compute[70645]:       <mac address="fa:16:3e:f2:f0:91"/>
Jul 24 14:57:58 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:58 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:57:58 user nova-compute[70645]:       <target dev="tapa192fa1c-14"/>
Jul 24 14:57:58 user nova-compute[70645]:     </interface>
Jul 24 14:57:58 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:57:58 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/console.log" append="off"/>
Jul 24 14:57:58 user nova-compute[70645]:     </serial>
Jul 24 14:57:58 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:57:58 user nova-compute[70645]:     <video>
Jul 24 14:57:58 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:57:58 user nova-compute[70645]:     </video>
Jul 24 14:57:58 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:57:58 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:57:58 user nova-compute[70645]:     </rng>
Jul 24 14:57:58 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:57:58 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:57:58 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:57:58 user nova-compute[70645]:     </memballoon>
Jul 24 14:57:58 user nova-compute[70645]:   </devices>
Jul 24 14:57:58 user nova-compute[70645]: </domain>
Jul 24 14:57:58 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-999275839',display_name='tempest-ServerRescueNegativeTestJSON-server-999275839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-999275839',id=20,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-wjnojzx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:57:55Z,user_data=None,user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=cf8bcde0-6825-45f0-85c3-14188211558c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f0:91,bridge_name='br-int',has_traffic_filtering=True,id=a192fa1c-1413-4f9a-bb16-8fd758373ce9,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa192fa1c-14') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG os_vif [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f0:91,bridge_name='br-int',has_traffic_filtering=True,id=a192fa1c-1413-4f9a-bb16-8fd758373ce9,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa192fa1c-14') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa192fa1c-14, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa192fa1c-14, col_values=(('external_ids', {'iface-id': 'a192fa1c-1413-4f9a-bb16-8fd758373ce9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:f0:91', 'vm-uuid': 'cf8bcde0-6825-45f0-85c3-14188211558c'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:58 user nova-compute[70645]: INFO os_vif [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f0:91,bridge_name='br-int',has_traffic_filtering=True,id=a192fa1c-1413-4f9a-bb16-8fd758373ce9,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa192fa1c-14')
Jul 24 14:57:58 user nova-compute[70645]: INFO nova.compute.manager [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Terminating instance
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No VIF found with MAC fa:16:3e:f2:f0:91, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.compute.manager [req-9355c155-5d9f-47e9-8398-5082dcebbca2 req-dfe44473-753b-457b-a807-5bebd2eb093c service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9355c155-5d9f-47e9-8398-5082dcebbca2 req-dfe44473-753b-457b-a807-5bebd2eb093c service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9355c155-5d9f-47e9-8398-5082dcebbca2 req-dfe44473-753b-457b-a807-5bebd2eb093c service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9355c155-5d9f-47e9-8398-5082dcebbca2 req-dfe44473-753b-457b-a807-5bebd2eb093c service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:58 user nova-compute[70645]: DEBUG nova.compute.manager [req-9355c155-5d9f-47e9-8398-5082dcebbca2 req-dfe44473-753b-457b-a807-5bebd2eb093c service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:58 user nova-compute[70645]: WARNING nova.compute.manager [req-9355c155-5d9f-47e9-8398-5082dcebbca2 req-dfe44473-753b-457b-a807-5bebd2eb093c service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received unexpected event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with vm_state building and task_state spawning.
Jul 24 14:57:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG nova.network.neutron [req-0f8443f1-18a7-42e5-9f9d-f48b73f26cba req-3655f87b-dc3e-43b6-9d5e-5bf6091ed8ee service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Updated VIF entry in instance network info cache for port a192fa1c-1413-4f9a-bb16-8fd758373ce9. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG nova.network.neutron [req-0f8443f1-18a7-42e5-9f9d-f48b73f26cba req-3655f87b-dc3e-43b6-9d5e-5bf6091ed8ee service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Updating instance_info_cache with network_info: [{"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0f8443f1-18a7-42e5-9f9d-f48b73f26cba req-3655f87b-dc3e-43b6-9d5e-5bf6091ed8ee service nova] Releasing lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-7bcc2f7f-9689-4e3b-8c2c-8b571e3ba9d8 req-d29f3d90-e9d4-4e7c-96e7-c64b64ccd894 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Received event network-vif-unplugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7bcc2f7f-9689-4e3b-8c2c-8b571e3ba9d8 req-d29f3d90-e9d4-4e7c-96e7-c64b64ccd894 service nova] Acquiring lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7bcc2f7f-9689-4e3b-8c2c-8b571e3ba9d8 req-d29f3d90-e9d4-4e7c-96e7-c64b64ccd894 service nova] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7bcc2f7f-9689-4e3b-8c2c-8b571e3ba9d8 req-d29f3d90-e9d4-4e7c-96e7-c64b64ccd894 service nova] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-7bcc2f7f-9689-4e3b-8c2c-8b571e3ba9d8 req-d29f3d90-e9d4-4e7c-96e7-c64b64ccd894 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] No waiting events found dispatching network-vif-unplugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:57:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-7bcc2f7f-9689-4e3b-8c2c-8b571e3ba9d8 req-d29f3d90-e9d4-4e7c-96e7-c64b64ccd894 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Received event network-vif-unplugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:58:00 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Instance destroyed successfully.
Jul 24 14:58:00 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lazy-loading 'resources' on Instance uuid dae4da41-53a6-44a5-bd36-90b9f6bb828d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1641424777',display_name='tempest-VolumesAdminNegativeTest-server-1641424777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1641424777',id=15,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:55:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a447bf5ed203471ab178b4433a1c40ce',ramdisk_id='',reservation_id='r-4d0kahuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1454211316',owner_user_name='tempest-VolumesAdminNegativeTest-1454211316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:56:00Z,user_data=None,user_id='ad0dc6a130114d50b702de26be47c3a0',uuid=dae4da41-53a6-44a5-bd36-90b9f6bb828d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "address": "fa:16:3e:07:59:53", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d93a4d-05", "ovs_interfaceid": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converting VIF {"id": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "address": "fa:16:3e:07:59:53", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d93a4d-05", "ovs_interfaceid": "77d93a4d-05e3-43c0-9cda-084b24a997f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:59:53,bridge_name='br-int',has_traffic_filtering=True,id=77d93a4d-05e3-43c0-9cda-084b24a997f5,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d93a4d-05') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG os_vif [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:59:53,bridge_name='br-int',has_traffic_filtering=True,id=77d93a4d-05e3-43c0-9cda-084b24a997f5,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d93a4d-05') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77d93a4d-05, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:00 user nova-compute[70645]: INFO os_vif [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:59:53,bridge_name='br-int',has_traffic_filtering=True,id=77d93a4d-05e3-43c0-9cda-084b24a997f5,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d93a4d-05')
Jul 24 14:58:00 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Deleting instance files /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d_del
Jul 24 14:58:00 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Deletion of /opt/stack/data/nova/instances/dae4da41-53a6-44a5-bd36-90b9f6bb828d_del complete
Jul 24 14:58:00 user nova-compute[70645]: INFO nova.compute.manager [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Took 1.87 seconds to destroy the instance on the hypervisor.
Jul 24 14:58:00 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-7a8cf006-4f8f-4f69-b473-ef546e3d6dcd req-9bd20b1b-d430-4d1f-a3fb-70d24c6b2254 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7a8cf006-4f8f-4f69-b473-ef546e3d6dcd req-9bd20b1b-d430-4d1f-a3fb-70d24c6b2254 service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7a8cf006-4f8f-4f69-b473-ef546e3d6dcd req-9bd20b1b-d430-4d1f-a3fb-70d24c6b2254 service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7a8cf006-4f8f-4f69-b473-ef546e3d6dcd req-9bd20b1b-d430-4d1f-a3fb-70d24c6b2254 service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-7a8cf006-4f8f-4f69-b473-ef546e3d6dcd req-9bd20b1b-d430-4d1f-a3fb-70d24c6b2254 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:00 user nova-compute[70645]: WARNING nova.compute.manager [req-7a8cf006-4f8f-4f69-b473-ef546e3d6dcd req-9bd20b1b-d430-4d1f-a3fb-70d24c6b2254 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received unexpected event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with vm_state building and task_state spawning.
Jul 24 14:58:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210681.1399636, 74c53188-2399-4515-94e6-4ff3e94d7559 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:58:01 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] VM Resumed (Lifecycle Event)
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:58:01 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Instance spawned successfully.
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-8dd876b7-ca44-42f3-887b-0eb9901ed0d8 req-ddc747d2-a0ed-4787-9451-1b13437b6128 service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8dd876b7-ca44-42f3-887b-0eb9901ed0d8 req-ddc747d2-a0ed-4787-9451-1b13437b6128 service nova] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8dd876b7-ca44-42f3-887b-0eb9901ed0d8 req-ddc747d2-a0ed-4787-9451-1b13437b6128 service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8dd876b7-ca44-42f3-887b-0eb9901ed0d8 req-ddc747d2-a0ed-4787-9451-1b13437b6128 service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-8dd876b7-ca44-42f3-887b-0eb9901ed0d8 req-ddc747d2-a0ed-4787-9451-1b13437b6128 service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] No waiting events found dispatching network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:01 user nova-compute[70645]: WARNING nova.compute.manager [req-8dd876b7-ca44-42f3-887b-0eb9901ed0d8 req-ddc747d2-a0ed-4787-9451-1b13437b6128 service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received unexpected event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 for instance with vm_state building and task_state spawning.
Jul 24 14:58:01 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210681.1489184, 74c53188-2399-4515-94e6-4ff3e94d7559 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:58:01 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] VM Started (Lifecycle Event)
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:58:01 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:58:01 user nova-compute[70645]: INFO nova.compute.manager [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Took 7.68 seconds to spawn the instance on the hypervisor.
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:01 user nova-compute[70645]: INFO nova.compute.manager [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Took 8.63 seconds to build instance.
Jul 24 14:58:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e832793-f59b-4fba-b7d8-0ef7038a9452 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "74c53188-2399-4515-94e6-4ff3e94d7559" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.803s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-f0b25f8e-ac3e-427b-9dac-e960be6270f2 req-f82b0205-87c0-43fe-9102-cebe7a0b5316 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Received event network-vif-plugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f0b25f8e-ac3e-427b-9dac-e960be6270f2 req-f82b0205-87c0-43fe-9102-cebe7a0b5316 service nova] Acquiring lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f0b25f8e-ac3e-427b-9dac-e960be6270f2 req-f82b0205-87c0-43fe-9102-cebe7a0b5316 service nova] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f0b25f8e-ac3e-427b-9dac-e960be6270f2 req-f82b0205-87c0-43fe-9102-cebe7a0b5316 service nova] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-f0b25f8e-ac3e-427b-9dac-e960be6270f2 req-f82b0205-87c0-43fe-9102-cebe7a0b5316 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] No waiting events found dispatching network-vif-plugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:01 user nova-compute[70645]: WARNING nova.compute.manager [req-f0b25f8e-ac3e-427b-9dac-e960be6270f2 req-f82b0205-87c0-43fe-9102-cebe7a0b5316 service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Received unexpected event network-vif-plugged-77d93a4d-05e3-43c0-9cda-084b24a997f5 for instance with vm_state active and task_state deleting.
Jul 24 14:58:01 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:58:01 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Took 1.17 seconds to deallocate network for instance.
Jul 24 14:58:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:02 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:58:02 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:58:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:02 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Deleted allocations for instance dae4da41-53a6-44a5-bd36-90b9f6bb828d
Jul 24 14:58:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2bc40fde-b3a7-46d9-b2e9-98b584ca2306 tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "dae4da41-53a6-44a5-bd36-90b9f6bb828d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.797s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:03 user nova-compute[70645]: INFO nova.compute.manager [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Terminating instance
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210683.2602375, cf8bcde0-6825-45f0-85c3-14188211558c => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:58:03 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] VM Resumed (Lifecycle Event)
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:58:03 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Instance spawned successfully.
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-13a7c593-5ce6-428e-a424-dee66c97ef03 req-0964156a-cce7-4853-a7e7-246c5c61a49d service nova] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Received event network-vif-deleted-77d93a4d-05e3-43c0-9cda-084b24a997f5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-13a7c593-5ce6-428e-a424-dee66c97ef03 req-0964156a-cce7-4853-a7e7-246c5c61a49d service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-13a7c593-5ce6-428e-a424-dee66c97ef03 req-0964156a-cce7-4853-a7e7-246c5c61a49d service nova] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-13a7c593-5ce6-428e-a424-dee66c97ef03 req-0964156a-cce7-4853-a7e7-246c5c61a49d service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-13a7c593-5ce6-428e-a424-dee66c97ef03 req-0964156a-cce7-4853-a7e7-246c5c61a49d service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-13a7c593-5ce6-428e-a424-dee66c97ef03 req-0964156a-cce7-4853-a7e7-246c5c61a49d service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] No waiting events found dispatching network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:03 user nova-compute[70645]: WARNING nova.compute.manager [req-13a7c593-5ce6-428e-a424-dee66c97ef03 req-0964156a-cce7-4853-a7e7-246c5c61a49d service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received unexpected event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 for instance with vm_state building and task_state spawning.
Jul 24 14:58:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:03 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210683.2663348, cf8bcde0-6825-45f0-85c3-14188211558c => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:58:03 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] VM Started (Lifecycle Event)
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:03 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:58:03 user nova-compute[70645]: INFO nova.compute.manager [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Took 8.27 seconds to spawn the instance on the hypervisor.
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:03 user nova-compute[70645]: INFO nova.compute.manager [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Took 9.35 seconds to build instance.
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ab4a8ff-75cd-4bdd-b00d-224272087b31 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "cf8bcde0-6825-45f0-85c3-14188211558c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.453s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-ed4cabe0-0a63-4ae2-9324-0e72f8eb99da req-24eca1b4-4d6b-4bfe-b221-58c2c145d0f9 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Received event network-vif-unplugged-ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ed4cabe0-0a63-4ae2-9324-0e72f8eb99da req-24eca1b4-4d6b-4bfe-b221-58c2c145d0f9 service nova] Acquiring lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ed4cabe0-0a63-4ae2-9324-0e72f8eb99da req-24eca1b4-4d6b-4bfe-b221-58c2c145d0f9 service nova] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ed4cabe0-0a63-4ae2-9324-0e72f8eb99da req-24eca1b4-4d6b-4bfe-b221-58c2c145d0f9 service nova] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-ed4cabe0-0a63-4ae2-9324-0e72f8eb99da req-24eca1b4-4d6b-4bfe-b221-58c2c145d0f9 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] No waiting events found dispatching network-vif-unplugged-ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-ed4cabe0-0a63-4ae2-9324-0e72f8eb99da req-24eca1b4-4d6b-4bfe-b221-58c2c145d0f9 service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Received event network-vif-unplugged-ffd805b9-7af4-452a-96ba-8abd05010a47 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:58:03 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Instance destroyed successfully.
Jul 24 14:58:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lazy-loading 'resources' on Instance uuid ff0bb392-a296-45a0-a102-f8b0e1c9d41a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:58:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-892164296',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-892164296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8921642',id=12,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUpY9OvtJb5gXTbB2ObE/iUFJ5fZIE6N1tqnldWOuY/UbNNJ6vWAen9O65+2TwhcbPVtG/xMR6HB7astU8BqHLmT//oydYQSahs+IIMrmyyMraXx8NcQGgQAQobcVw6NQ==',key_name='tempest-keypair-1872331603',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:55:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='603f18c021ae49fab9aaaa4b5f1fa780',ramdisk_id='',reservation_id='r-5wtie27j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1390540328',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:55:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c802a14cf1642aaa356c481fe000696',uuid=ff0bb392-a296-45a0-a102-f8b0e1c9d41a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffd805b9-7af4-452a-96ba-8abd05010a47", "address": "fa:16:3e:22:c2:66", "network": {"id": "7d870511-075a-4fa7-83ef-9147e626f8f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1824197985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603f18c021ae49fab9aaaa4b5f1fa780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd805b9-7a", "ovs_interfaceid": "ffd805b9-7af4-452a-96ba-8abd05010a47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:58:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Converting VIF {"id": "ffd805b9-7af4-452a-96ba-8abd05010a47", "address": "fa:16:3e:22:c2:66", "network": {"id": "7d870511-075a-4fa7-83ef-9147e626f8f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1824197985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603f18c021ae49fab9aaaa4b5f1fa780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd805b9-7a", "ovs_interfaceid": "ffd805b9-7af4-452a-96ba-8abd05010a47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:58:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:c2:66,bridge_name='br-int',has_traffic_filtering=True,id=ffd805b9-7af4-452a-96ba-8abd05010a47,network=Network(7d870511-075a-4fa7-83ef-9147e626f8f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd805b9-7a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:58:04 user nova-compute[70645]: DEBUG os_vif [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:c2:66,bridge_name='br-int',has_traffic_filtering=True,id=ffd805b9-7af4-452a-96ba-8abd05010a47,network=Network(7d870511-075a-4fa7-83ef-9147e626f8f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd805b9-7a') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:58:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffd805b9-7a, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:58:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:58:04 user nova-compute[70645]: INFO os_vif [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:c2:66,bridge_name='br-int',has_traffic_filtering=True,id=ffd805b9-7af4-452a-96ba-8abd05010a47,network=Network(7d870511-075a-4fa7-83ef-9147e626f8f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd805b9-7a')
Jul 24 14:58:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Deleting instance files /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a_del
Jul 24 14:58:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Deletion of /opt/stack/data/nova/instances/ff0bb392-a296-45a0-a102-f8b0e1c9d41a_del complete
Jul 24 14:58:04 user nova-compute[70645]: INFO nova.compute.manager [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 24 14:58:04 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:58:04 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:58:04 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:58:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:05 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:58:05 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Took 1.37 seconds to deallocate network for instance.
Jul 24 14:58:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-67290613-a73b-4526-b0ef-7a6c5a33bc6e req-ce4dfe6d-b46a-48ab-8d02-1994ca7742ea service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Received event network-vif-deleted-ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:05 user nova-compute[70645]: INFO nova.compute.manager [req-67290613-a73b-4526-b0ef-7a6c5a33bc6e req-ce4dfe6d-b46a-48ab-8d02-1994ca7742ea service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Neutron deleted interface ffd805b9-7af4-452a-96ba-8abd05010a47; detaching it from the instance and deleting it from the info cache
Jul 24 14:58:05 user nova-compute[70645]: DEBUG nova.network.neutron [req-67290613-a73b-4526-b0ef-7a6c5a33bc6e req-ce4dfe6d-b46a-48ab-8d02-1994ca7742ea service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:58:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-67290613-a73b-4526-b0ef-7a6c5a33bc6e req-ce4dfe6d-b46a-48ab-8d02-1994ca7742ea service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Detach interface failed, port_id=ffd805b9-7af4-452a-96ba-8abd05010a47, reason: Instance ff0bb392-a296-45a0-a102-f8b0e1c9d41a could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 14:58:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-2458e538-231a-45af-848b-08507f82d2ab req-7301a593-39fd-4ca8-8ef2-f8d25f83cdcc service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Received event network-vif-plugged-ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2458e538-231a-45af-848b-08507f82d2ab req-7301a593-39fd-4ca8-8ef2-f8d25f83cdcc service nova] Acquiring lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2458e538-231a-45af-848b-08507f82d2ab req-7301a593-39fd-4ca8-8ef2-f8d25f83cdcc service nova] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2458e538-231a-45af-848b-08507f82d2ab req-7301a593-39fd-4ca8-8ef2-f8d25f83cdcc service nova] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-2458e538-231a-45af-848b-08507f82d2ab req-7301a593-39fd-4ca8-8ef2-f8d25f83cdcc service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] No waiting events found dispatching network-vif-plugged-ffd805b9-7af4-452a-96ba-8abd05010a47 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:05 user nova-compute[70645]: WARNING nova.compute.manager [req-2458e538-231a-45af-848b-08507f82d2ab req-7301a593-39fd-4ca8-8ef2-f8d25f83cdcc service nova] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Received unexpected event network-vif-plugged-ffd805b9-7af4-452a-96ba-8abd05010a47 for instance with vm_state deleted and task_state None.
Jul 24 14:58:06 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:58:06 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:58:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:06 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Deleted allocations for instance ff0bb392-a296-45a0-a102-f8b0e1c9d41a
Jul 24 14:58:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea7775c7-0ba4-48a0-8768-97420205138b tempest-TestServerVolumeAttachScenarioOldVersion-1390540328 tempest-TestServerVolumeAttachScenarioOldVersion-1390540328-project-member] Lock "ff0bb392-a296-45a0-a102-f8b0e1c9d41a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.132s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:10 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:10 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70645) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 14:58:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:13 user nova-compute[70645]: DEBUG nova.compute.manager [req-e3495f3f-377d-49c4-9078-34eb5bce3b85 req-15428a8b-f8ea-4e52-9174-fff4545fe014 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-changed-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:13 user nova-compute[70645]: DEBUG nova.compute.manager [req-e3495f3f-377d-49c4-9078-34eb5bce3b85 req-15428a8b-f8ea-4e52-9174-fff4545fe014 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Refreshing instance network info cache due to event network-changed-254aef5a-c4f8-473b-a2c0-6db998ebc479. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:58:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e3495f3f-377d-49c4-9078-34eb5bce3b85 req-15428a8b-f8ea-4e52-9174-fff4545fe014 service nova] Acquiring lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:58:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e3495f3f-377d-49c4-9078-34eb5bce3b85 req-15428a8b-f8ea-4e52-9174-fff4545fe014 service nova] Acquired lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:58:13 user nova-compute[70645]: DEBUG nova.network.neutron [req-e3495f3f-377d-49c4-9078-34eb5bce3b85 req-15428a8b-f8ea-4e52-9174-fff4545fe014 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Refreshing network info cache for port 254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:58:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:14 user nova-compute[70645]: DEBUG nova.network.neutron [req-e3495f3f-377d-49c4-9078-34eb5bce3b85 req-15428a8b-f8ea-4e52-9174-fff4545fe014 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updated VIF entry in instance network info cache for port 254aef5a-c4f8-473b-a2c0-6db998ebc479. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:58:14 user nova-compute[70645]: DEBUG nova.network.neutron [req-e3495f3f-377d-49c4-9078-34eb5bce3b85 req-15428a8b-f8ea-4e52-9174-fff4545fe014 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updating instance_info_cache with network_info: [{"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:58:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e3495f3f-377d-49c4-9078-34eb5bce3b85 req-15428a8b-f8ea-4e52-9174-fff4545fe014 service nova] Releasing lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:58:15 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210680.395644, dae4da41-53a6-44a5-bd36-90b9f6bb828d => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:58:15 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] VM Stopped (Lifecycle Event)
Jul 24 14:58:15 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e65cdc40-6d3f-4c46-82ac-866f26914523 None None] [instance: dae4da41-53a6-44a5-bd36-90b9f6bb828d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:15 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:58:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:15 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:58:15 user nova-compute[70645]: INFO nova.compute.claims [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Claim successful on node user
Jul 24 14:58:15 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:15 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 14:58:15 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.215s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:58:16 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:58:16 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Creating image(s)
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "/opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "/opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.policy [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9ba00b9477d416ba510bf66b424c1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d01222b2028429fae08bb542e5cd9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk 1073741824" returned: 0 in 0.053s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.137s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Cannot resize image /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'migration_context' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Ensure instance console log exists: /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Successfully created port: 84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Successfully updated port: 84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-16c111b2-a351-46d2-a67a-77646944c868 req-02c0f029-420a-4274-a1f7-3caeefbd8b2a service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-changed-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-16c111b2-a351-46d2-a67a-77646944c868 req-02c0f029-420a-4274-a1f7-3caeefbd8b2a service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Refreshing instance network info cache due to event network-changed-84e43646-0d11-4aad-8ace-40d9d0d4aacc. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-16c111b2-a351-46d2-a67a-77646944c868 req-02c0f029-420a-4274-a1f7-3caeefbd8b2a service nova] Acquiring lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-16c111b2-a351-46d2-a67a-77646944c868 req-02c0f029-420a-4274-a1f7-3caeefbd8b2a service nova] Acquired lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.network.neutron [req-16c111b2-a351-46d2-a67a-77646944c868 req-02c0f029-420a-4274-a1f7-3caeefbd8b2a service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Refreshing network info cache for port 84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.network.neutron [req-16c111b2-a351-46d2-a67a-77646944c868 req-02c0f029-420a-4274-a1f7-3caeefbd8b2a service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.network.neutron [req-16c111b2-a351-46d2-a67a-77646944c868 req-02c0f029-420a-4274-a1f7-3caeefbd8b2a service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-16c111b2-a351-46d2-a67a-77646944c868 req-02c0f029-420a-4274-a1f7-3caeefbd8b2a service nova] Releasing lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquired lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updating instance_info_cache with network_info: [{"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Releasing lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance network_info: |[{"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Start _get_guest_xml network_info=[{"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:58:18 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:58:18 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1918489519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1918489519',id=21,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy5TsjK5j9HCl9mLdX6AaZM+2QGOGiecv426IZtv6DpfNck1CagDBFF7p/xYc78uCqhIY0GMZJHT90HiD7ZmVpYpGtK6yNYvpcTLHn4cg/C/ja0/grJ5zcOTPgsQ91Ggg==',key_name='tempest-keypair-2073152801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-gcl1160i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=9ea99927-77d9-4e98-b435-d4c781031d90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:58:18 user nova-compute[70645]:   <uuid>9ea99927-77d9-4e98-b435-d4c781031d90</uuid>
Jul 24 14:58:18 user nova-compute[70645]:   <name>instance-00000015</name>
Jul 24 14:58:18 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:58:18 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:58:18 user nova-compute[70645]:   <metadata>
Jul 24 14:58:18 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:58:18 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:58:18 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1918489519</nova:name>
Jul 24 14:58:18 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:58:18</nova:creationTime>
Jul 24 14:58:18 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:58:18 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:58:18 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:58:18 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:58:18 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:58:18 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:58:18 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:58:18 user nova-compute[70645]:       <nova:owner>
Jul 24 14:58:18 user nova-compute[70645]:         <nova:user uuid="d9ba00b9477d416ba510bf66b424c1f9">tempest-AttachVolumeShelveTestJSON-218162714-project-member</nova:user>
Jul 24 14:58:18 user nova-compute[70645]:         <nova:project uuid="5d01222b2028429fae08bb542e5cd9cc">tempest-AttachVolumeShelveTestJSON-218162714</nova:project>
Jul 24 14:58:18 user nova-compute[70645]:       </nova:owner>
Jul 24 14:58:18 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:58:18 user nova-compute[70645]:       <nova:ports>
Jul 24 14:58:18 user nova-compute[70645]:         <nova:port uuid="84e43646-0d11-4aad-8ace-40d9d0d4aacc">
Jul 24 14:58:18 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 14:58:18 user nova-compute[70645]:         </nova:port>
Jul 24 14:58:18 user nova-compute[70645]:       </nova:ports>
Jul 24 14:58:18 user nova-compute[70645]:     </nova:instance>
Jul 24 14:58:18 user nova-compute[70645]:   </metadata>
Jul 24 14:58:18 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:58:18 user nova-compute[70645]:     <system>
Jul 24 14:58:18 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:58:18 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:58:18 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:58:18 user nova-compute[70645]:       <entry name="serial">9ea99927-77d9-4e98-b435-d4c781031d90</entry>
Jul 24 14:58:18 user nova-compute[70645]:       <entry name="uuid">9ea99927-77d9-4e98-b435-d4c781031d90</entry>
Jul 24 14:58:18 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:58:18 user nova-compute[70645]:     </system>
Jul 24 14:58:18 user nova-compute[70645]:   </sysinfo>
Jul 24 14:58:18 user nova-compute[70645]:   <os>
Jul 24 14:58:18 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:58:18 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:58:18 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:58:18 user nova-compute[70645]:   </os>
Jul 24 14:58:18 user nova-compute[70645]:   <features>
Jul 24 14:58:18 user nova-compute[70645]:     <acpi/>
Jul 24 14:58:18 user nova-compute[70645]:     <apic/>
Jul 24 14:58:18 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:58:18 user nova-compute[70645]:   </features>
Jul 24 14:58:18 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:58:18 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:58:18 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:58:18 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:58:18 user nova-compute[70645]:   </clock>
Jul 24 14:58:18 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:58:18 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:58:18 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:58:18 user nova-compute[70645]:   </cpu>
Jul 24 14:58:18 user nova-compute[70645]:   <devices>
Jul 24 14:58:18 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:58:18 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:58:18 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk"/>
Jul 24 14:58:18 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:58:18 user nova-compute[70645]:     </disk>
Jul 24 14:58:18 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:58:18 user nova-compute[70645]:       <mac address="fa:16:3e:38:37:ef"/>
Jul 24 14:58:18 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:58:18 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:58:18 user nova-compute[70645]:       <target dev="tap84e43646-0d"/>
Jul 24 14:58:18 user nova-compute[70645]:     </interface>
Jul 24 14:58:18 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:58:18 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/console.log" append="off"/>
Jul 24 14:58:18 user nova-compute[70645]:     </serial>
Jul 24 14:58:18 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:58:18 user nova-compute[70645]:     <video>
Jul 24 14:58:18 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:58:18 user nova-compute[70645]:     </video>
Jul 24 14:58:18 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:58:18 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:58:18 user nova-compute[70645]:     </rng>
Jul 24 14:58:18 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:58:18 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:58:18 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:58:18 user nova-compute[70645]:     </memballoon>
Jul 24 14:58:18 user nova-compute[70645]:   </devices>
Jul 24 14:58:18 user nova-compute[70645]: </domain>
Jul 24 14:58:18 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1918489519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1918489519',id=21,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy5TsjK5j9HCl9mLdX6AaZM+2QGOGiecv426IZtv6DpfNck1CagDBFF7p/xYc78uCqhIY0GMZJHT90HiD7ZmVpYpGtK6yNYvpcTLHn4cg/C/ja0/grJ5zcOTPgsQ91Ggg==',key_name='tempest-keypair-2073152801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-gcl1160i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=9ea99927-77d9-4e98-b435-d4c781031d90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG os_vif [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84e43646-0d, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84e43646-0d, col_values=(('external_ids', {'iface-id': '84e43646-0d11-4aad-8ace-40d9d0d4aacc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:37:ef', 'vm-uuid': '9ea99927-77d9-4e98-b435-d4c781031d90'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:18 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210683.9928722, ff0bb392-a296-45a0-a102-f8b0e1c9d41a => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:58:18 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] VM Stopped (Lifecycle Event)
Jul 24 14:58:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:58:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-10168b55-5a72-4769-99cf-afa3b12fac4b None None] [instance: ff0bb392-a296-45a0-a102-f8b0e1c9d41a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:19 user nova-compute[70645]: INFO os_vif [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d')
Jul 24 14:58:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:58:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] No VIF found with MAC fa:16:3e:38:37:ef, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:58:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210702.6847894, 9ea99927-77d9-4e98-b435-d4c781031d90 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:58:23 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] VM Resumed (Lifecycle Event)
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-75d8a528-ca26-42a5-8c50-72433ff7e52a req-8ef4f709-b706-4ef0-96a7-fb87fcd7ac5c service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-75d8a528-ca26-42a5-8c50-72433ff7e52a req-8ef4f709-b706-4ef0-96a7-fb87fcd7ac5c service nova] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-75d8a528-ca26-42a5-8c50-72433ff7e52a req-8ef4f709-b706-4ef0-96a7-fb87fcd7ac5c service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-75d8a528-ca26-42a5-8c50-72433ff7e52a req-8ef4f709-b706-4ef0-96a7-fb87fcd7ac5c service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-75d8a528-ca26-42a5-8c50-72433ff7e52a req-8ef4f709-b706-4ef0-96a7-fb87fcd7ac5c service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] No waiting events found dispatching network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:23 user nova-compute[70645]: WARNING nova.compute.manager [req-75d8a528-ca26-42a5-8c50-72433ff7e52a req-8ef4f709-b706-4ef0-96a7-fb87fcd7ac5c service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received unexpected event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc for instance with vm_state building and task_state spawning.
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-a28141da-9651-49d7-a1e7-ca98ade53c38 req-ebd45928-f49d-4733-9534-d255e94ed2b8 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a28141da-9651-49d7-a1e7-ca98ade53c38 req-ebd45928-f49d-4733-9534-d255e94ed2b8 service nova] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a28141da-9651-49d7-a1e7-ca98ade53c38 req-ebd45928-f49d-4733-9534-d255e94ed2b8 service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a28141da-9651-49d7-a1e7-ca98ade53c38 req-ebd45928-f49d-4733-9534-d255e94ed2b8 service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-a28141da-9651-49d7-a1e7-ca98ade53c38 req-ebd45928-f49d-4733-9534-d255e94ed2b8 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] No waiting events found dispatching network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:23 user nova-compute[70645]: WARNING nova.compute.manager [req-a28141da-9651-49d7-a1e7-ca98ade53c38 req-ebd45928-f49d-4733-9534-d255e94ed2b8 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received unexpected event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc for instance with vm_state building and task_state spawning.
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:58:23 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:58:23 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=6996MB free_disk=25.594768524169922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:23 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance spawned successfully.
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 14:58:23 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210702.6876962, 9ea99927-77d9-4e98-b435-d4c781031d90 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:58:23 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] VM Started (Lifecycle Event)
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:58:23 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:58:23 user nova-compute[70645]: INFO nova.compute.manager [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Took 7.02 seconds to spawn the instance on the hypervisor.
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 046adfbd-fa5f-45f5-ae62-ddc0f834d450 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance f1a667e2-7992-44e4-9500-fa598493e173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance dd796d18-9a13-40b8-9f4e-0a9dd93d4149 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 460ae655-2955-4a45-9b12-2a3ddd9f448b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 6fafa215-3ee5-4efb-816a-1d9f72e667da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 293709a6-cd86-4153-9a9c-a7bc05fc65fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 9ea99927-77d9-4e98-b435-d4c781031d90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 734abf9a-96dd-40b4-9b68-2d42fa079216 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1724}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:58:23 user nova-compute[70645]: INFO nova.compute.manager [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Took 7.97 seconds to build instance.
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c9f28528-5477-4c2c-8cbb-eebcfa6e07c4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.108s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.714s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.532s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:58:23 user nova-compute[70645]: INFO nova.compute.claims [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Claim successful on node user
Jul 24 14:58:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] There are 0 instances to clean {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 14:58:24 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 14:58:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG nova.policy [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa4b836a11a044a583cb21072f0e4922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dacb396f6be4936ac1c4d115bf98d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 14:58:24 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Creating image(s)
Jul 24 14:58:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "/opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "/opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "/opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk 1073741824" returned: 0 in 0.061s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Cannot resize image /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'migration_context' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Ensure instance console log exists: /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Successfully created port: 634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:25 user nova-compute[70645]: INFO nova.compute.manager [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Terminating instance
Jul 24 14:58:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 14:58:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Skipping network cache update for instance because it is being deleted. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9839}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Skipping network cache update for instance because it is Building. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid b13c0261-b25c-48ce-9245-fa43dadc1829 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-7f4768fc-7c99-4ed5-8bb3-cde73ae3d27e req-ae3cb459-1278-4b45-8794-c0c2efecc0e2 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-vif-unplugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7f4768fc-7c99-4ed5-8bb3-cde73ae3d27e req-ae3cb459-1278-4b45-8794-c0c2efecc0e2 service nova] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7f4768fc-7c99-4ed5-8bb3-cde73ae3d27e req-ae3cb459-1278-4b45-8794-c0c2efecc0e2 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7f4768fc-7c99-4ed5-8bb3-cde73ae3d27e req-ae3cb459-1278-4b45-8794-c0c2efecc0e2 service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-7f4768fc-7c99-4ed5-8bb3-cde73ae3d27e req-ae3cb459-1278-4b45-8794-c0c2efecc0e2 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] No waiting events found dispatching network-vif-unplugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-7f4768fc-7c99-4ed5-8bb3-cde73ae3d27e req-ae3cb459-1278-4b45-8794-c0c2efecc0e2 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-vif-unplugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:58:26 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Instance destroyed successfully.
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.objects.instance [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lazy-loading 'resources' on Instance uuid dd796d18-9a13-40b8-9f4e-0a9dd93d4149 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T14:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-857172397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-688018022',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwoqgcpuew/lBL0A4HvDTZZKuMR4W08vCGF6DHg1WPwF1CRmpQpivSWEIG4F/2elmJ0HJ8+k9QG4CGPETqeUnBFSkbmxAYPCMF6V6tJyegjLzXd8TOfUwgbFBlNNmwaPA==',key_name='tempest-keypair-1741933867',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31b3ae943a2a40b6a83674d048fa7805',ramdisk_id='',reservation_id='r-9kpb6uxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-870483127',owner_user_name='tempest-ServerActionsV293TestJSON-870483127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:57:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd2d003c18c4541b9c6f2ae64cc95f6',uuid=dd796d18-9a13-40b8-9f4e-0a9dd93d4149,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converting VIF {"id": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "address": "fa:16:3e:ea:18:90", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682dc45-20", "ovs_interfaceid": "8682dc45-20b4-4e10-aaaf-fa86015cad6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_vif [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Successfully updated port: 634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8682dc45-20, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:26 user nova-compute[70645]: INFO os_vif [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:18:90,bridge_name='br-int',has_traffic_filtering=True,id=8682dc45-20b4-4e10-aaaf-fa86015cad6b,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682dc45-20')
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCvVFDMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:58:26 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquired lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11f7c2a-26f0-4ada-b970-0ae49c88818b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-f5172252-b13b-4c8b-b8f6-8dae87a5b116 req-37fadfab-9152-4b37-9960-037d1ffc0cb1 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-changed-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-f5172252-b13b-4c8b-b8f6-8dae87a5b116 req-37fadfab-9152-4b37-9960-037d1ffc0cb1 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Refreshing instance network info cache due to event network-changed-634fb15f-19aa-462c-931b-dd76f2ce93b0. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f5172252-b13b-4c8b-b8f6-8dae87a5b116 req-37fadfab-9152-4b37-9960-037d1ffc0cb1 service nova] Acquiring lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1adbcab-716c-4517-beb6-b9921ce4493a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:58:26 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:58:26 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:58:26 user nova-compute[70645]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d (non-flash)
Jul 24 14:58:26 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba94122440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35a916b-c7e1-419a-a3de-602a52a4cd18]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c17bce-ccba-4914-8655-4f5881039428]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d767f06-3c5d-4da1-9141-fb09a111fde8]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb99e47-5dc5-44d1-a839-ceb26ad813de]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Updating instance_info_cache with network_info: [{"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87f3b48-bac4-443b-ae66-75b675cd5fe0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:58:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5745b50-f4ef-4c97-aaa1-8e510aa5303e]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260]
Jul 24 14:58:27 user nova-compute[70645]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d, portal: 172.16.0.220,3260] successful.
Jul 24 14:58:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c54412-e306-45ab-a248-e0eafd284a4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e974a431-0080-4a63-8cb3-6e8944e536a2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] <== disconnect_volume: return (337ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:58:27 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Deleting instance files /opt/stack/data/nova/instances/dd796d18-9a13-40b8-9f4e-0a9dd93d4149_del
Jul 24 14:58:27 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Deletion of /opt/stack/data/nova/instances/dd796d18-9a13-40b8-9f4e-0a9dd93d4149_del complete
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Updating instance_info_cache with network_info: [{"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Releasing lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance network_info: |[{"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f5172252-b13b-4c8b-b8f6-8dae87a5b116 req-37fadfab-9152-4b37-9960-037d1ffc0cb1 service nova] Acquired lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.network.neutron [req-f5172252-b13b-4c8b-b8f6-8dae87a5b116 req-37fadfab-9152-4b37-9960-037d1ffc0cb1 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Refreshing network info cache for port 634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Start _get_guest_xml network_info=[{"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:58:27 user nova-compute[70645]: INFO nova.compute.manager [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Took 1.29 seconds to destroy the instance on the hypervisor.
Jul 24 14:58:27 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:58:27 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:58:27 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1841824952',display_name='tempest-AttachVolumeTestJSON-server-1841824952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1841824952',id=22,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMLbkQBMsR4a+hDUBr6a7aRbORe6/on6xHkq0RJlZIGJHHSRDeijoBX284tbAvvwuA6Lxntt8t7PR2NgacxtAM+JNC3dlGGca1WYyP9ZD/+aBRiNcvf5TmXBq0Tu+cQQw==',key_name='tempest-keypair-548846795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-x9wujour',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=734abf9a-96dd-40b4-9b68-2d42fa079216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'pci_devices' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:58:27 user nova-compute[70645]:   <uuid>734abf9a-96dd-40b4-9b68-2d42fa079216</uuid>
Jul 24 14:58:27 user nova-compute[70645]:   <name>instance-00000016</name>
Jul 24 14:58:27 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:58:27 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:58:27 user nova-compute[70645]:   <metadata>
Jul 24 14:58:27 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:58:27 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:58:27 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeTestJSON-server-1841824952</nova:name>
Jul 24 14:58:27 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:58:27</nova:creationTime>
Jul 24 14:58:27 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:58:27 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:58:27 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:58:27 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:58:27 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:58:27 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:58:27 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:58:27 user nova-compute[70645]:       <nova:owner>
Jul 24 14:58:27 user nova-compute[70645]:         <nova:user uuid="fa4b836a11a044a583cb21072f0e4922">tempest-AttachVolumeTestJSON-1397935195-project-member</nova:user>
Jul 24 14:58:27 user nova-compute[70645]:         <nova:project uuid="2dacb396f6be4936ac1c4d115bf98d6a">tempest-AttachVolumeTestJSON-1397935195</nova:project>
Jul 24 14:58:27 user nova-compute[70645]:       </nova:owner>
Jul 24 14:58:27 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:58:27 user nova-compute[70645]:       <nova:ports>
Jul 24 14:58:27 user nova-compute[70645]:         <nova:port uuid="634fb15f-19aa-462c-931b-dd76f2ce93b0">
Jul 24 14:58:27 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 14:58:27 user nova-compute[70645]:         </nova:port>
Jul 24 14:58:27 user nova-compute[70645]:       </nova:ports>
Jul 24 14:58:27 user nova-compute[70645]:     </nova:instance>
Jul 24 14:58:27 user nova-compute[70645]:   </metadata>
Jul 24 14:58:27 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:58:27 user nova-compute[70645]:     <system>
Jul 24 14:58:27 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:58:27 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:58:27 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:58:27 user nova-compute[70645]:       <entry name="serial">734abf9a-96dd-40b4-9b68-2d42fa079216</entry>
Jul 24 14:58:27 user nova-compute[70645]:       <entry name="uuid">734abf9a-96dd-40b4-9b68-2d42fa079216</entry>
Jul 24 14:58:27 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:58:27 user nova-compute[70645]:     </system>
Jul 24 14:58:27 user nova-compute[70645]:   </sysinfo>
Jul 24 14:58:27 user nova-compute[70645]:   <os>
Jul 24 14:58:27 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:58:27 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:58:27 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:58:27 user nova-compute[70645]:   </os>
Jul 24 14:58:27 user nova-compute[70645]:   <features>
Jul 24 14:58:27 user nova-compute[70645]:     <acpi/>
Jul 24 14:58:27 user nova-compute[70645]:     <apic/>
Jul 24 14:58:27 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:58:27 user nova-compute[70645]:   </features>
Jul 24 14:58:27 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:58:27 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:58:27 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:58:27 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:58:27 user nova-compute[70645]:   </clock>
Jul 24 14:58:27 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:58:27 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:58:27 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:58:27 user nova-compute[70645]:   </cpu>
Jul 24 14:58:27 user nova-compute[70645]:   <devices>
Jul 24 14:58:27 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:58:27 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:58:27 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk"/>
Jul 24 14:58:27 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:58:27 user nova-compute[70645]:     </disk>
Jul 24 14:58:27 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:58:27 user nova-compute[70645]:       <mac address="fa:16:3e:c7:b9:c5"/>
Jul 24 14:58:27 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:58:27 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:58:27 user nova-compute[70645]:       <target dev="tap634fb15f-19"/>
Jul 24 14:58:27 user nova-compute[70645]:     </interface>
Jul 24 14:58:27 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:58:27 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/console.log" append="off"/>
Jul 24 14:58:27 user nova-compute[70645]:     </serial>
Jul 24 14:58:27 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:58:27 user nova-compute[70645]:     <video>
Jul 24 14:58:27 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:58:27 user nova-compute[70645]:     </video>
Jul 24 14:58:27 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:58:27 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:58:27 user nova-compute[70645]:     </rng>
Jul 24 14:58:27 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:58:27 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:58:27 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:58:27 user nova-compute[70645]:     </memballoon>
Jul 24 14:58:27 user nova-compute[70645]:   </devices>
Jul 24 14:58:27 user nova-compute[70645]: </domain>
Jul 24 14:58:27 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1841824952',display_name='tempest-AttachVolumeTestJSON-server-1841824952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1841824952',id=22,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMLbkQBMsR4a+hDUBr6a7aRbORe6/on6xHkq0RJlZIGJHHSRDeijoBX284tbAvvwuA6Lxntt8t7PR2NgacxtAM+JNC3dlGGca1WYyP9ZD/+aBRiNcvf5TmXBq0Tu+cQQw==',key_name='tempest-keypair-548846795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-x9wujour',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=734abf9a-96dd-40b4-9b68-2d42fa079216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG os_vif [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap634fb15f-19, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap634fb15f-19, col_values=(('external_ids', {'iface-id': '634fb15f-19aa-462c-931b-dd76f2ce93b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:b9:c5', 'vm-uuid': '734abf9a-96dd-40b4-9b68-2d42fa079216'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:27 user nova-compute[70645]: INFO os_vif [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19')
Jul 24 14:58:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No VIF found with MAC fa:16:3e:c7:b9:c5, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.network.neutron [req-f5172252-b13b-4c8b-b8f6-8dae87a5b116 req-37fadfab-9152-4b37-9960-037d1ffc0cb1 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Updated VIF entry in instance network info cache for port 634fb15f-19aa-462c-931b-dd76f2ce93b0. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG nova.network.neutron [req-f5172252-b13b-4c8b-b8f6-8dae87a5b116 req-37fadfab-9152-4b37-9960-037d1ffc0cb1 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Updating instance_info_cache with network_info: [{"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:58:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f5172252-b13b-4c8b-b8f6-8dae87a5b116 req-37fadfab-9152-4b37-9960-037d1ffc0cb1 service nova] Releasing lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:58:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d3df698-bf91-43ec-b348-a96ef4661286 req-47864bc6-9155-443e-bc51-79a23e81b6cd service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d3df698-bf91-43ec-b348-a96ef4661286 req-47864bc6-9155-443e-bc51-79a23e81b6cd service nova] Acquiring lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d3df698-bf91-43ec-b348-a96ef4661286 req-47864bc6-9155-443e-bc51-79a23e81b6cd service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d3df698-bf91-43ec-b348-a96ef4661286 req-47864bc6-9155-443e-bc51-79a23e81b6cd service nova] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d3df698-bf91-43ec-b348-a96ef4661286 req-47864bc6-9155-443e-bc51-79a23e81b6cd service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] No waiting events found dispatching network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:28 user nova-compute[70645]: WARNING nova.compute.manager [req-8d3df698-bf91-43ec-b348-a96ef4661286 req-47864bc6-9155-443e-bc51-79a23e81b6cd service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received unexpected event network-vif-plugged-8682dc45-20b4-4e10-aaaf-fa86015cad6b for instance with vm_state active and task_state deleting.
Jul 24 14:58:28 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:58:28 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Took 1.34 seconds to deallocate network for instance.
Jul 24 14:58:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-f9d419d7-83e5-45c2-a86a-bef9124f4173 req-03f20374-bce1-4ba1-9afd-acc520dd1653 service nova] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Received event network-vif-deleted-8682dc45-20b4-4e10-aaaf-fa86015cad6b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-7d44f343-4406-4bf6-a589-8ba751b33766 req-efa14bc8-613a-405c-b565-2bf8643ff504 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7d44f343-4406-4bf6-a589-8ba751b33766 req-efa14bc8-613a-405c-b565-2bf8643ff504 service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7d44f343-4406-4bf6-a589-8ba751b33766 req-efa14bc8-613a-405c-b565-2bf8643ff504 service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7d44f343-4406-4bf6-a589-8ba751b33766 req-efa14bc8-613a-405c-b565-2bf8643ff504 service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-7d44f343-4406-4bf6-a589-8ba751b33766 req-efa14bc8-613a-405c-b565-2bf8643ff504 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:29 user nova-compute[70645]: WARNING nova.compute.manager [req-7d44f343-4406-4bf6-a589-8ba751b33766 req-efa14bc8-613a-405c-b565-2bf8643ff504 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state building and task_state spawning.
Jul 24 14:58:29 user nova-compute[70645]: INFO nova.compute.manager [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Took 0.87 seconds to detach 1 volumes for instance.
Jul 24 14:58:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Deleting volume: 93c54412-e306-45ab-a248-e0eafd284a4d {{(pid=70645) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:58:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:29 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Deleted allocations for instance dd796d18-9a13-40b8-9f4e-0a9dd93d4149
Jul 24 14:58:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3370437a-1e25-4749-ae73-43bfdc605eda tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "dd796d18-9a13-40b8-9f4e-0a9dd93d4149" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.215s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:30 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210710.980148, 734abf9a-96dd-40b4-9b68-2d42fa079216 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:58:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] VM Resumed (Lifecycle Event)
Jul 24 14:58:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:58:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 14:58:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance spawned successfully.
Jul 24 14:58:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:58:31 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210710.9859676, 734abf9a-96dd-40b4-9b68-2d42fa079216 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:58:31 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] VM Started (Lifecycle Event)
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:58:31 user nova-compute[70645]: INFO nova.compute.manager [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Took 6.34 seconds to spawn the instance on the hypervisor.
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:31 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-4c38456a-f785-45b5-abb8-75abb6f42599 req-3546c832-22fb-422e-bccf-c6c68db74287 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4c38456a-f785-45b5-abb8-75abb6f42599 req-3546c832-22fb-422e-bccf-c6c68db74287 service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4c38456a-f785-45b5-abb8-75abb6f42599 req-3546c832-22fb-422e-bccf-c6c68db74287 service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4c38456a-f785-45b5-abb8-75abb6f42599 req-3546c832-22fb-422e-bccf-c6c68db74287 service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-4c38456a-f785-45b5-abb8-75abb6f42599 req-3546c832-22fb-422e-bccf-c6c68db74287 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:31 user nova-compute[70645]: WARNING nova.compute.manager [req-4c38456a-f785-45b5-abb8-75abb6f42599 req-3546c832-22fb-422e-bccf-c6c68db74287 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state building and task_state spawning.
Jul 24 14:58:31 user nova-compute[70645]: INFO nova.compute.manager [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Took 7.85 seconds to build instance.
Jul 24 14:58:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c4edeada-23ff-4c8f-9f7d-b49a7ede46eb tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.020s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid b13c0261-b25c-48ce-9245-fa43dadc1829 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 046adfbd-fa5f-45f5-ae62-ddc0f834d450 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid f1a667e2-7992-44e4-9500-fa598493e173 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 293709a6-cd86-4153-9a9c-a7bc05fc65fb {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid cf8bcde0-6825-45f0-85c3-14188211558c {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "b13c0261-b25c-48ce-9245-fa43dadc1829" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "f1a667e2-7992-44e4-9500-fa598493e173" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "f1a667e2-7992-44e4-9500-fa598493e173" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "74c53188-2399-4515-94e6-4ff3e94d7559" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "cf8bcde0-6825-45f0-85c3-14188211558c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:33 user nova-compute[70645]: WARNING oslo_messaging._drivers.amqpdriver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "cf8bcde0-6825-45f0-85c3-14188211558c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "f1a667e2-7992-44e4-9500-fa598493e173" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "74c53188-2399-4515-94e6-4ff3e94d7559" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.167s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.181s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.179s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:41 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210706.6045375, dd796d18-9a13-40b8-9f4e-0a9dd93d4149 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:58:41 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] VM Stopped (Lifecycle Event)
Jul 24 14:58:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3fa90558-621c-4819-b392-5be14ae94247 None None] [instance: dd796d18-9a13-40b8-9f4e-0a9dd93d4149] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:58:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "f1a667e2-7992-44e4-9500-fa598493e173" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "f1a667e2-7992-44e4-9500-fa598493e173-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:53 user nova-compute[70645]: INFO nova.compute.manager [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Terminating instance
Jul 24 14:58:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-8fe0e9f4-2ed3-46ab-871d-e12a7f71f4a3 req-3eb15fc9-c22f-43bb-bdd9-177bc2204ede service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Received event network-vif-unplugged-014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8fe0e9f4-2ed3-46ab-871d-e12a7f71f4a3 req-3eb15fc9-c22f-43bb-bdd9-177bc2204ede service nova] Acquiring lock "f1a667e2-7992-44e4-9500-fa598493e173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8fe0e9f4-2ed3-46ab-871d-e12a7f71f4a3 req-3eb15fc9-c22f-43bb-bdd9-177bc2204ede service nova] Lock "f1a667e2-7992-44e4-9500-fa598493e173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8fe0e9f4-2ed3-46ab-871d-e12a7f71f4a3 req-3eb15fc9-c22f-43bb-bdd9-177bc2204ede service nova] Lock "f1a667e2-7992-44e4-9500-fa598493e173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-8fe0e9f4-2ed3-46ab-871d-e12a7f71f4a3 req-3eb15fc9-c22f-43bb-bdd9-177bc2204ede service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] No waiting events found dispatching network-vif-unplugged-014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-8fe0e9f4-2ed3-46ab-871d-e12a7f71f4a3 req-3eb15fc9-c22f-43bb-bdd9-177bc2204ede service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Received event network-vif-unplugged-014795b1-c234-4335-acff-79b1fbab054f for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:58:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Instance destroyed successfully.
Jul 24 14:58:54 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lazy-loading 'resources' on Instance uuid f1a667e2-7992-44e4-9500-fa598493e173 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:58:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-277836927',display_name='tempest-VolumesAdminNegativeTest-server-277836927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-277836927',id=4,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBEMvH71kMDeV9PbYWIRXYgvaeeLhBCKYNCQZWUmqzuPPVkzoAaPlw05OXDu2joEy9KiAkCtw/+uwt96fyGNbH7nxoS5+dRstXP1kJWq+h0Vfp9wdZCUF4iAbk4NHd87w==',key_name='tempest-keypair-1716874696',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a447bf5ed203471ab178b4433a1c40ce',ramdisk_id='',reservation_id='r-yzmbjspm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1454211316',owner_user_name='tempest-VolumesAdminNegativeTest-1454211316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad0dc6a130114d50b702de26be47c3a0',uuid=f1a667e2-7992-44e4-9500-fa598493e173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "014795b1-c234-4335-acff-79b1fbab054f", "address": "fa:16:3e:4d:44:3f", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014795b1-c2", "ovs_interfaceid": "014795b1-c234-4335-acff-79b1fbab054f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:58:54 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converting VIF {"id": "014795b1-c234-4335-acff-79b1fbab054f", "address": "fa:16:3e:4d:44:3f", "network": {"id": "93c7c53c-101c-408f-b191-f117eec7772d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1697125929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a447bf5ed203471ab178b4433a1c40ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014795b1-c2", "ovs_interfaceid": "014795b1-c234-4335-acff-79b1fbab054f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:58:54 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:44:3f,bridge_name='br-int',has_traffic_filtering=True,id=014795b1-c234-4335-acff-79b1fbab054f,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014795b1-c2') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:58:54 user nova-compute[70645]: DEBUG os_vif [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:44:3f,bridge_name='br-int',has_traffic_filtering=True,id=014795b1-c234-4335-acff-79b1fbab054f,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014795b1-c2') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:58:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap014795b1-c2, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:58:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:54 user nova-compute[70645]: INFO os_vif [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:44:3f,bridge_name='br-int',has_traffic_filtering=True,id=014795b1-c234-4335-acff-79b1fbab054f,network=Network(93c7c53c-101c-408f-b191-f117eec7772d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014795b1-c2')
Jul 24 14:58:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Deleting instance files /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173_del
Jul 24 14:58:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Deletion of /opt/stack/data/nova/instances/f1a667e2-7992-44e4-9500-fa598493e173_del complete
Jul 24 14:58:54 user nova-compute[70645]: INFO nova.compute.manager [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 24 14:58:54 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:58:54 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:58:54 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: f1a667e2-7992-44e4-9500-fa598493e173] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:58:54 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:58:55 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Took 0.91 seconds to deallocate network for instance.
Jul 24 14:58:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-c24a07b2-ba5f-4b5a-b3a7-95909167beb4 req-adebc6da-c274-43c2-b92e-29cec7efca42 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Received event network-vif-deleted-014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Refreshing inventories for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Updating ProviderTree inventory for provider a0cf5b80-69d2-4191-894e-a498eab7d688 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Refreshing aggregate associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, aggregates: None {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Refreshing trait associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-f2e8c0b8-6528-438a-8a91-3e7025a78dd1 req-ce98428c-d4bc-402a-a271-b6a6b50f4f23 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Received event network-vif-plugged-014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f2e8c0b8-6528-438a-8a91-3e7025a78dd1 req-ce98428c-d4bc-402a-a271-b6a6b50f4f23 service nova] Acquiring lock "f1a667e2-7992-44e4-9500-fa598493e173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f2e8c0b8-6528-438a-8a91-3e7025a78dd1 req-ce98428c-d4bc-402a-a271-b6a6b50f4f23 service nova] Lock "f1a667e2-7992-44e4-9500-fa598493e173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f2e8c0b8-6528-438a-8a91-3e7025a78dd1 req-ce98428c-d4bc-402a-a271-b6a6b50f4f23 service nova] Lock "f1a667e2-7992-44e4-9500-fa598493e173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-f2e8c0b8-6528-438a-8a91-3e7025a78dd1 req-ce98428c-d4bc-402a-a271-b6a6b50f4f23 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] No waiting events found dispatching network-vif-plugged-014795b1-c234-4335-acff-79b1fbab054f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:58:55 user nova-compute[70645]: WARNING nova.compute.manager [req-f2e8c0b8-6528-438a-8a91-3e7025a78dd1 req-ce98428c-d4bc-402a-a271-b6a6b50f4f23 service nova] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Received unexpected event network-vif-plugged-014795b1-c234-4335-acff-79b1fbab054f for instance with vm_state deleted and task_state None.
Jul 24 14:58:55 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:58:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.753s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:55 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Deleted allocations for instance f1a667e2-7992-44e4-9500-fa598493e173
Jul 24 14:58:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c49d1281-c985-4d38-a8dd-7f88f294374a tempest-VolumesAdminNegativeTest-1454211316 tempest-VolumesAdminNegativeTest-1454211316-project-member] Lock "f1a667e2-7992-44e4-9500-fa598493e173" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.752s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:58:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:58:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:01 user nova-compute[70645]: INFO nova.compute.manager [None req-dba95db7-cc3c-48cd-a539-0a56651a8436 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Unrescuing
Jul 24 14:59:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-dba95db7-cc3c-48cd-a539-0a56651a8436 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:59:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-dba95db7-cc3c-48cd-a539-0a56651a8436 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquired lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:59:01 user nova-compute[70645]: DEBUG nova.network.neutron [None req-dba95db7-cc3c-48cd-a539-0a56651a8436 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:59:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:01 user nova-compute[70645]: DEBUG nova.network.neutron [None req-dba95db7-cc3c-48cd-a539-0a56651a8436 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Updating instance_info_cache with network_info: [{"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:59:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-dba95db7-cc3c-48cd-a539-0a56651a8436 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Releasing lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:59:01 user nova-compute[70645]: DEBUG nova.objects.instance [None req-dba95db7-cc3c-48cd-a539-0a56651a8436 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'flavor' on Instance uuid 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-4aaa0f12-aa55-4f11-828a-e964ea28d8f6 req-416492d0-b686-4cbf-8363-883314e988cc service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-unplugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4aaa0f12-aa55-4f11-828a-e964ea28d8f6 req-416492d0-b686-4cbf-8363-883314e988cc service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4aaa0f12-aa55-4f11-828a-e964ea28d8f6 req-416492d0-b686-4cbf-8363-883314e988cc service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4aaa0f12-aa55-4f11-828a-e964ea28d8f6 req-416492d0-b686-4cbf-8363-883314e988cc service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-4aaa0f12-aa55-4f11-828a-e964ea28d8f6 req-416492d0-b686-4cbf-8363-883314e988cc service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-unplugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:02 user nova-compute[70645]: WARNING nova.compute.manager [req-4aaa0f12-aa55-4f11-828a-e964ea28d8f6 req-416492d0-b686-4cbf-8363-883314e988cc service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received unexpected event network-vif-unplugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with vm_state rescued and task_state unrescuing.
Jul 24 14:59:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:02 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Instance destroyed successfully.
Jul 24 14:59:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:04 user nova-compute[70645]: WARNING nova.compute.manager [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received unexpected event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with vm_state rescued and task_state unrescuing.
Jul 24 14:59:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:04 user nova-compute[70645]: WARNING nova.compute.manager [req-c1d1dc07-08e7-4e38-93f0-6539ff5299c8 req-45b8db88-e54c-4440-a656-dc057c46d32a service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received unexpected event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with vm_state rescued and task_state unrescuing.
Jul 24 14:59:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 14:59:06 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210746.0742064, 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:59:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] VM Resumed (Lifecycle Event)
Jul 24 14:59:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-dba95db7-cc3c-48cd-a539-0a56651a8436 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:59:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 14:59:06 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210746.0760646, 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:59:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] VM Started (Lifecycle Event)
Jul 24 14:59:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:59:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-ce90e558-bcc1-4e7d-a2aa-f0469a3873b6 req-c4e9246b-12f7-4ac6-bebd-e4a6bf90a165 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ce90e558-bcc1-4e7d-a2aa-f0469a3873b6 req-c4e9246b-12f7-4ac6-bebd-e4a6bf90a165 service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ce90e558-bcc1-4e7d-a2aa-f0469a3873b6 req-c4e9246b-12f7-4ac6-bebd-e4a6bf90a165 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ce90e558-bcc1-4e7d-a2aa-f0469a3873b6 req-c4e9246b-12f7-4ac6-bebd-e4a6bf90a165 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-ce90e558-bcc1-4e7d-a2aa-f0469a3873b6 req-c4e9246b-12f7-4ac6-bebd-e4a6bf90a165 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:06 user nova-compute[70645]: WARNING nova.compute.manager [req-ce90e558-bcc1-4e7d-a2aa-f0469a3873b6 req-c4e9246b-12f7-4ac6-bebd-e4a6bf90a165 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received unexpected event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with vm_state active and task_state None.
Jul 24 14:59:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:09 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210734.00864, f1a667e2-7992-44e4-9500-fa598493e173 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:59:09 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: f1a667e2-7992-44e4-9500-fa598493e173] VM Stopped (Lifecycle Event)
Jul 24 14:59:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e660d062-ecc9-4efe-aab7-b89a33df1d1c None None] [instance: f1a667e2-7992-44e4-9500-fa598493e173] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:16 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:59:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 14:59:16 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:59:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:16 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:17 user nova-compute[70645]: INFO nova.compute.manager [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Terminating instance
Jul 24 14:59:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG nova.compute.manager [req-c7beeda4-8808-42f3-8ded-b718f998dbef req-8427bc97-6cd0-4c15-9c5c-bcb1c90b0396 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Received event network-vif-unplugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c7beeda4-8808-42f3-8ded-b718f998dbef req-8427bc97-6cd0-4c15-9c5c-bcb1c90b0396 service nova] Acquiring lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c7beeda4-8808-42f3-8ded-b718f998dbef req-8427bc97-6cd0-4c15-9c5c-bcb1c90b0396 service nova] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c7beeda4-8808-42f3-8ded-b718f998dbef req-8427bc97-6cd0-4c15-9c5c-bcb1c90b0396 service nova] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG nova.compute.manager [req-c7beeda4-8808-42f3-8ded-b718f998dbef req-8427bc97-6cd0-4c15-9c5c-bcb1c90b0396 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] No waiting events found dispatching network-vif-unplugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG nova.compute.manager [req-c7beeda4-8808-42f3-8ded-b718f998dbef req-8427bc97-6cd0-4c15-9c5c-bcb1c90b0396 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Received event network-vif-unplugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:17 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Instance destroyed successfully.
Jul 24 14:59:17 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lazy-loading 'resources' on Instance uuid 046adfbd-fa5f-45f5-ae62-ddc0f834d450 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-789722581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-789722581',id=3,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/aTOFfjx7zBVxywZhX3SOR7dB9dUYs0a2tdsQCFgb6PPyU3MZJ/9Ynhvci08plMzAFM27bWLA3PW1Y+NohDaneE1t1PJIMpviSO4+jGN6BYIC43gRL9aGFDqvvXByGgA==',key_name='tempest-keypair-36914743',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:52:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31b3ae943a2a40b6a83674d048fa7805',ramdisk_id='',reservation_id='r-esbwduzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-870483127',owner_user_name='tempest-ServerActionsV293TestJSON-870483127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:52:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd2d003c18c4541b9c6f2ae64cc95f6',uuid=046adfbd-fa5f-45f5-ae62-ddc0f834d450,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converting VIF {"id": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "address": "fa:16:3e:79:5c:b2", "network": {"id": "b1c77d3f-0e92-462c-897f-a5ce428ef744", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-89091103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b3ae943a2a40b6a83674d048fa7805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0cfcb9-c0", "ovs_interfaceid": "ae0cfcb9-c004-4e79-b81b-93401c1629c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:5c:b2,bridge_name='br-int',has_traffic_filtering=True,id=ae0cfcb9-c004-4e79-b81b-93401c1629c7,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0cfcb9-c0') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG os_vif [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:5c:b2,bridge_name='br-int',has_traffic_filtering=True,id=ae0cfcb9-c004-4e79-b81b-93401c1629c7,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0cfcb9-c0') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae0cfcb9-c0, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:59:17 user nova-compute[70645]: INFO os_vif [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:5c:b2,bridge_name='br-int',has_traffic_filtering=True,id=ae0cfcb9-c004-4e79-b81b-93401c1629c7,network=Network(b1c77d3f-0e92-462c-897f-a5ce428ef744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0cfcb9-c0')
Jul 24 14:59:17 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Deleting instance files /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450_del
Jul 24 14:59:17 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Deletion of /opt/stack/data/nova/instances/046adfbd-fa5f-45f5-ae62-ddc0f834d450_del complete
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:59:17 user nova-compute[70645]: INFO nova.compute.manager [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Took 0.68 seconds to destroy the instance on the hypervisor.
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:18 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Error from libvirt while getting description of instance-00000003: [Error Code 42] Domain not found: no domain with matching uuid '046adfbd-fa5f-45f5-ae62-ddc0f834d450' (instance-00000003): libvirt.libvirtError: Domain not found: no domain with matching uuid '046adfbd-fa5f-45f5-ae62-ddc0f834d450' (instance-00000003)
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-1745d3ae-f529-453b-9d8f-fe1fe27a9b9c req-1502208c-7d7f-4822-a518-da65069dae58 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Received event network-vif-deleted-ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:18 user nova-compute[70645]: INFO nova.compute.manager [req-1745d3ae-f529-453b-9d8f-fe1fe27a9b9c req-1502208c-7d7f-4822-a518-da65069dae58 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Neutron deleted interface ae0cfcb9-c004-4e79-b81b-93401c1629c7; detaching it from the instance and deleting it from the info cache
Jul 24 14:59:18 user nova-compute[70645]: DEBUG nova.network.neutron [req-1745d3ae-f529-453b-9d8f-fe1fe27a9b9c req-1502208c-7d7f-4822-a518-da65069dae58 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:59:18 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Took 0.97 seconds to deallocate network for instance.
Jul 24 14:59:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-1745d3ae-f529-453b-9d8f-fe1fe27a9b9c req-1502208c-7d7f-4822-a518-da65069dae58 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Detach interface failed, port_id=ae0cfcb9-c004-4e79-b81b-93401c1629c7, reason: Instance 046adfbd-fa5f-45f5-ae62-ddc0f834d450 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:19 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Deleted allocations for instance 046adfbd-fa5f-45f5-ae62-ddc0f834d450
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d59ba7c9-8a81-49aa-92b8-7183f4885537 tempest-ServerActionsV293TestJSON-870483127 tempest-ServerActionsV293TestJSON-870483127-project-member] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.326s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-2c0e0cac-a0fb-4d60-9009-954b41b0d01d req-8152fa1d-5ab3-45d0-ae34-bc3aca0c5776 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Received event network-vif-plugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2c0e0cac-a0fb-4d60-9009-954b41b0d01d req-8152fa1d-5ab3-45d0-ae34-bc3aca0c5776 service nova] Acquiring lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2c0e0cac-a0fb-4d60-9009-954b41b0d01d req-8152fa1d-5ab3-45d0-ae34-bc3aca0c5776 service nova] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2c0e0cac-a0fb-4d60-9009-954b41b0d01d req-8152fa1d-5ab3-45d0-ae34-bc3aca0c5776 service nova] Lock "046adfbd-fa5f-45f5-ae62-ddc0f834d450-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-2c0e0cac-a0fb-4d60-9009-954b41b0d01d req-8152fa1d-5ab3-45d0-ae34-bc3aca0c5776 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] No waiting events found dispatching network-vif-plugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:19 user nova-compute[70645]: WARNING nova.compute.manager [req-2c0e0cac-a0fb-4d60-9009-954b41b0d01d req-8152fa1d-5ab3-45d0-ae34-bc3aca0c5776 service nova] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Received unexpected event network-vif-plugged-ae0cfcb9-c004-4e79-b81b-93401c1629c7 for instance with vm_state deleted and task_state None.
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-ac4da3a7-8d4c-430a-88d1-95cdbb6b32e6 req-3b683ef1-5d28-4c3e-8395-9994eb6aecd0 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-changed-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-ac4da3a7-8d4c-430a-88d1-95cdbb6b32e6 req-3b683ef1-5d28-4c3e-8395-9994eb6aecd0 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Refreshing instance network info cache due to event network-changed-02ca6838-89e2-41bc-a858-dc7a007f7960. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ac4da3a7-8d4c-430a-88d1-95cdbb6b32e6 req-3b683ef1-5d28-4c3e-8395-9994eb6aecd0 service nova] Acquiring lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ac4da3a7-8d4c-430a-88d1-95cdbb6b32e6 req-3b683ef1-5d28-4c3e-8395-9994eb6aecd0 service nova] Acquired lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG nova.network.neutron [req-ac4da3a7-8d4c-430a-88d1-95cdbb6b32e6 req-3b683ef1-5d28-4c3e-8395-9994eb6aecd0 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Refreshing network info cache for port 02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:20 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:59:20 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7161MB free_disk=25.526290893554688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:20 user nova-compute[70645]: INFO nova.compute.manager [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Terminating instance
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 460ae655-2955-4a45-9b12-2a3ddd9f448b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 6fafa215-3ee5-4efb-816a-1d9f72e667da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 293709a6-cd86-4153-9a9c-a7bc05fc65fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 9ea99927-77d9-4e98-b435-d4c781031d90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 734abf9a-96dd-40b4-9b68-2d42fa079216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.network.neutron [req-ac4da3a7-8d4c-430a-88d1-95cdbb6b32e6 req-3b683ef1-5d28-4c3e-8395-9994eb6aecd0 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updated VIF entry in instance network info cache for port 02ca6838-89e2-41bc-a858-dc7a007f7960. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.network.neutron [req-ac4da3a7-8d4c-430a-88d1-95cdbb6b32e6 req-3b683ef1-5d28-4c3e-8395-9994eb6aecd0 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updating instance_info_cache with network_info: [{"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ac4da3a7-8d4c-430a-88d1-95cdbb6b32e6 req-3b683ef1-5d28-4c3e-8395-9994eb6aecd0 service nova] Releasing lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-4cfa004c-48b6-48a6-8bfc-50dbfd314b65 req-76a55823-3b99-46b2-af1c-5935ffd747de service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Received event network-vif-unplugged-b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4cfa004c-48b6-48a6-8bfc-50dbfd314b65 req-76a55823-3b99-46b2-af1c-5935ffd747de service nova] Acquiring lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4cfa004c-48b6-48a6-8bfc-50dbfd314b65 req-76a55823-3b99-46b2-af1c-5935ffd747de service nova] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4cfa004c-48b6-48a6-8bfc-50dbfd314b65 req-76a55823-3b99-46b2-af1c-5935ffd747de service nova] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-4cfa004c-48b6-48a6-8bfc-50dbfd314b65 req-76a55823-3b99-46b2-af1c-5935ffd747de service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] No waiting events found dispatching network-vif-unplugged-b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-4cfa004c-48b6-48a6-8bfc-50dbfd314b65 req-76a55823-3b99-46b2-af1c-5935ffd747de service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Received event network-vif-unplugged-b61c1912-d140-47c3-bb0c-09b73959bffb for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:59:20 user nova-compute[70645]: INFO nova.compute.manager [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] instance snapshotting
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 14:59:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Beginning live snapshot process
Jul 24 14:59:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json -f qcow2 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Instance destroyed successfully.
Jul 24 14:59:21 user nova-compute[70645]: DEBUG nova.objects.instance [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lazy-loading 'resources' on Instance uuid 293709a6-cd86-4153-9a9c-a7bc05fc65fb {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1029059461',display_name='tempest-VolumesActionsTest-instance-1029059461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1029059461',id=18,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68682834554049928782963eab8ea32b',ramdisk_id='',reservation_id='r-x2g9rc72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1302908910',owner_user_name='tempest-VolumesActionsTest-1302908910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:57:38Z,user_data=None,user_id='b715d50164af4254aecf7156d617fa34',uuid=293709a6-cd86-4153-9a9c-a7bc05fc65fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b61c1912-d140-47c3-bb0c-09b73959bffb", "address": "fa:16:3e:8c:34:50", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61c1912-d1", "ovs_interfaceid": "b61c1912-d140-47c3-bb0c-09b73959bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converting VIF {"id": "b61c1912-d140-47c3-bb0c-09b73959bffb", "address": "fa:16:3e:8c:34:50", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61c1912-d1", "ovs_interfaceid": "b61c1912-d140-47c3-bb0c-09b73959bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:50,bridge_name='br-int',has_traffic_filtering=True,id=b61c1912-d140-47c3-bb0c-09b73959bffb,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61c1912-d1') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG os_vif [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:50,bridge_name='br-int',has_traffic_filtering=True,id=b61c1912-d140-47c3-bb0c-09b73959bffb,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61c1912-d1') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb61c1912-d1, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:59:21 user nova-compute[70645]: INFO os_vif [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:50,bridge_name='br-int',has_traffic_filtering=True,id=b61c1912-d140-47c3-bb0c-09b73959bffb,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61c1912-d1')
Jul 24 14:59:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Deleting instance files /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb_del
Jul 24 14:59:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Deletion of /opt/stack/data/nova/instances/293709a6-cd86-4153-9a9c-a7bc05fc65fb_del complete
Jul 24 14:59:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json -f qcow2 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:21 user nova-compute[70645]: INFO nova.compute.manager [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 24 14:59:21 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp64jx413a/6bc43686fc264f62bbc8f2193f37721c.delta 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp64jx413a/6bc43686fc264f62bbc8f2193f37721c.delta 1073741824" returned: 0 in 0.050s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 14:59:21 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 14:59:21 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:59:21 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Took 0.64 seconds to deallocate network for instance.
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:22 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Deleted allocations for instance 293709a6-cd86-4153-9a9c-a7bc05fc65fb
Jul 24 14:59:22 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Updating instance_info_cache with network_info: [{"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a24c5598-0d52-4b84-ada8-18562f3d6cb9 tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.261s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 14:59:22 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 14:59:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e39a013-9eed-4966-951d-0b9ad38952cd req-148432d0-cf3c-4aaa-84dc-0627cdb5f7ab service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Received event network-vif-plugged-b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e39a013-9eed-4966-951d-0b9ad38952cd req-148432d0-cf3c-4aaa-84dc-0627cdb5f7ab service nova] Acquiring lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e39a013-9eed-4966-951d-0b9ad38952cd req-148432d0-cf3c-4aaa-84dc-0627cdb5f7ab service nova] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e39a013-9eed-4966-951d-0b9ad38952cd req-148432d0-cf3c-4aaa-84dc-0627cdb5f7ab service nova] Lock "293709a6-cd86-4153-9a9c-a7bc05fc65fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e39a013-9eed-4966-951d-0b9ad38952cd req-148432d0-cf3c-4aaa-84dc-0627cdb5f7ab service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] No waiting events found dispatching network-vif-plugged-b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:22 user nova-compute[70645]: WARNING nova.compute.manager [req-3e39a013-9eed-4966-951d-0b9ad38952cd req-148432d0-cf3c-4aaa-84dc-0627cdb5f7ab service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Received unexpected event network-vif-plugged-b61c1912-d140-47c3-bb0c-09b73959bffb for instance with vm_state deleted and task_state None.
Jul 24 14:59:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e39a013-9eed-4966-951d-0b9ad38952cd req-148432d0-cf3c-4aaa-84dc-0627cdb5f7ab service nova] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Received event network-vif-deleted-b61c1912-d140-47c3-bb0c-09b73959bffb {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 14:59:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp64jx413a/6bc43686fc264f62bbc8f2193f37721c.delta /opt/stack/data/nova/instances/snapshots/tmp64jx413a/6bc43686fc264f62bbc8f2193f37721c {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp64jx413a/6bc43686fc264f62bbc8f2193f37721c.delta /opt/stack/data/nova/instances/snapshots/tmp64jx413a/6bc43686fc264f62bbc8f2193f37721c" returned: 0 in 0.797s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:23 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Snapshot extracted, beginning image upload
Jul 24 14:59:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 14:59:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:26 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Snapshot image upload complete
Jul 24 14:59:26 user nova-compute[70645]: INFO nova.compute.manager [None req-36ed6de5-3c6a-4507-999d-bee13ce29667 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Took 5.67 seconds to snapshot the instance on the hypervisor.
Jul 24 14:59:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG nova.objects.instance [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'flavor' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:29 user nova-compute[70645]: INFO nova.compute.manager [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Attaching volume 9814e40c-d816-44f0-9243-eb5d61f88153 to /dev/vdb
Jul 24 14:59:29 user nova-compute[70645]: DEBUG os_brick.utils [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1992e436-e41f-4049-b1e5-2263d568b218]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca587b94-229f-427a-9060-ee00aef6267d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[023e0d63-edca-4d3d-a56f-866e4fd1712e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9364a47c-acf9-44b3-8a14-7490ef9b9a63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:59:29 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:59:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7cc619-b076-4b17-9c05-af0f180b527d]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG os_brick.utils [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:59:29 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating existing volume attachment record: 2132c23c-070d-40bd-8ade-316d8b745963 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 14:59:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:32 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210757.6249595, 046adfbd-fa5f-45f5-ae62-ddc0f834d450 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:59:32 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] VM Stopped (Lifecycle Event)
Jul 24 14:59:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e548c4b7-988c-4631-ac2f-85228bcd9391 None None] [instance: 046adfbd-fa5f-45f5-ae62-ddc0f834d450] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYVBiqzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:59:35 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:59:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:59:35 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:59:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:59:35 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eef04e6-ef41-47b2-9b3b-9030a15a124a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:59:35 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5d8c02-a382-4b30-8cb5-cfe99af0b9bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153] added
Jul 24 14:59:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb90a2b9-c65a-454e-911a-0fdbf8b9dbfd]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d9a9e5-736f-435a-b99c-9818c63a9967]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYVBiqzZ {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYVBiqzZ" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5028da48-c8ef-4d9a-bec2-ac5dc361e987]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYVBiqzZ'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.112s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c91dd08-e8c5-4b6c-9122-20dc08b2730f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd46c06-e4db-494f-a034-222fa49667c0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:59:36 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:59:36 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210761.194766, 293709a6-cd86-4153-9a9c-a7bc05fc65fb => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:59:36 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] VM Stopped (Lifecycle Event)
Jul 24 14:59:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e23901f-ca88-4c02-8701-6881e374b438]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]
Jul 24 14:59:36 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.
Jul 24 14:59:36 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-a3b547c4-ef4c-4ca9-8198-2bda237b643e None None] [instance: 293709a6-cd86-4153-9a9c-a7bc05fc65fb] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f22b128-525e-46ce-be84-0469d031e884]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7850fdb7-994f-4cab-9078-0788224021c0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:59:36 user nova-compute[70645]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 14:59:36 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:59:36 user nova-compute[70645]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 14:59:36 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec8aaf5-7031-4d56-9e9e-a1d2cf087ce7]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:59:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYVBiqzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:59:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:59:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23364316336366339', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:59:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364316336366339', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:59:37 user nova-compute[70645]: DEBUG nova.objects.instance [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'flavor' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 14:59:37 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:59:37 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 14:59:37 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 14:59:37 user nova-compute[70645]:   <serial>9814e40c-d816-44f0-9243-eb5d61f88153</serial>
Jul 24 14:59:37 user nova-compute[70645]: </disk>
Jul 24 14:59:37 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 14:59:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:59:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:59:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] No VIF found with MAC fa:16:3e:46:ef:9d, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:59:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-efd22e4a-047c-4e05-8092-c81528cba886 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.226s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Stashing vm_state: active {{(pid=70645) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 24 14:59:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'pci_requests' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 14:59:39 user nova-compute[70645]: INFO nova.compute.claims [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Claim successful on node user
Jul 24 14:59:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'resources' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'pci_devices' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:39 user nova-compute[70645]: INFO nova.compute.resource_tracker [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating resource usage from migration 2b4eadff-48a4-4aa1-8719-898abf635907
Jul 24 14:59:40 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 14:59:40 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 14:59:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.428s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:40 user nova-compute[70645]: INFO nova.compute.manager [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Migrating
Jul 24 14:59:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:59:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquired lock "compute-rpcapi-router" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:59:40 user nova-compute[70645]: INFO nova.compute.rpcapi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 24 14:59:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Releasing lock "compute-rpcapi-router" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:59:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:59:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquired lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:59:40 user nova-compute[70645]: DEBUG nova.network.neutron [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:59:40 user nova-compute[70645]: DEBUG nova.network.neutron [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating instance_info_cache with network_info: [{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:59:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Releasing lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:59:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Starting migrate_disk_and_power_off {{(pid=70645) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-65d7976b-9789-4187-a2a3-36473f2e74f6 req-e5dc0ba2-ad18-4360-8088-9fff484ba940 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-unplugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-65d7976b-9789-4187-a2a3-36473f2e74f6 req-e5dc0ba2-ad18-4360-8088-9fff484ba940 service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-65d7976b-9789-4187-a2a3-36473f2e74f6 req-e5dc0ba2-ad18-4360-8088-9fff484ba940 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-65d7976b-9789-4187-a2a3-36473f2e74f6 req-e5dc0ba2-ad18-4360-8088-9fff484ba940 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-65d7976b-9789-4187-a2a3-36473f2e74f6 req-e5dc0ba2-ad18-4360-8088-9fff484ba940 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-unplugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:41 user nova-compute[70645]: WARNING nova.compute.manager [req-65d7976b-9789-4187-a2a3-36473f2e74f6 req-e5dc0ba2-ad18-4360-8088-9fff484ba940 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received unexpected event network-vif-unplugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with vm_state active and task_state resize_migrating.
Jul 24 14:59:41 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance destroyed successfully.
Jul 24 14:59:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887972996',display_name='tempest-ServerActionsTestOtherB-server-1887972996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887972996',id=14,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMleqYhBZCEEjJJsaMEuckPLdRSggssXX58+jSUDWV4RWgJi1aCvZ7GKXmFcDgd20RUebLSGWW0+tvwfBRktv2c+QmVz9Ve3ikoCtp5+5Q7Q8T6xY4TIWukXrdzPtz1wFA==',key_name='tempest-keypair-1765023642',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a7fb98af2b84c51a448d39d957f5f6a',ramdisk_id='',reservation_id='r-fex15wu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-589948319',owner_user_name='tempest-ServerActionsTestOtherB-589948319-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:59:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01c8ead2665a44c8a24dd89ee3b18a72',uuid=460ae655-2955-4a45-9b12-2a3ddd9f448b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1563413765-network", "vif_mac": "fa:16:3e:46:ef:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converting VIF {"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1563413765-network", "vif_mac": "fa:16:3e:46:ef:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_vif [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a56f8d6-1f, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:59:41 user nova-compute[70645]: INFO os_vif [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f')
Jul 24 14:59:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYVBiqzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:59:41 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15c3161-b9d9-4566-9fe4-5db907c4057d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a655b71d-29fc-429b-8b28-19eb414ec09b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:59:41 user nova-compute[70645]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 14:59:41 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:59:41 user nova-compute[70645]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 14:59:41 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbaa1e93be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd6c9c1-3532-4427-aae7-686d1769d031]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a5fe0-642c-4504-bdb5-87ff89a9a537]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e29a6-467d-4f85-985b-0a27a5149acb]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee1795e-503b-4f38-9a5c-952d50b01fff]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[29820e5e-fbd9-4bb7-98e3-24a2910f015e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebacd26-8461-4b25-bfd2-d6c771ab26b6]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]
Jul 24 14:59:41 user nova-compute[70645]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.
Jul 24 14:59:41 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e75142c-4335-4b3e-90cb-b9109a623be8]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.232s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] <== disconnect_volume: return (233ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 14:59:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 14:59:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b_resize/disk /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "cp -r /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b_resize/disk /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk" returned: 0 in 0.252s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b_resize/disk.info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk.info {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "cp -r /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b_resize/disk.info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk.info" returned: 0 in 0.032s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-4d7c8fde-c7d3-4c4e-b82d-d2180bc74586 req-3ac732c6-e19a-4bba-8f1f-53821c50e838 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4d7c8fde-c7d3-4c4e-b82d-d2180bc74586 req-3ac732c6-e19a-4bba-8f1f-53821c50e838 service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4d7c8fde-c7d3-4c4e-b82d-d2180bc74586 req-3ac732c6-e19a-4bba-8f1f-53821c50e838 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4d7c8fde-c7d3-4c4e-b82d-d2180bc74586 req-3ac732c6-e19a-4bba-8f1f-53821c50e838 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-4d7c8fde-c7d3-4c4e-b82d-d2180bc74586 req-3ac732c6-e19a-4bba-8f1f-53821c50e838 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:43 user nova-compute[70645]: WARNING nova.compute.manager [req-4d7c8fde-c7d3-4c4e-b82d-d2180bc74586 req-3ac732c6-e19a-4bba-8f1f-53821c50e838 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received unexpected event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with vm_state active and task_state resize_migrating.
Jul 24 14:59:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Port 3a56f8d6-1f50-46b0-949f-a64d933dd392 binding to destination host user is already ACTIVE {{(pid=70645) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 24 14:59:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:59:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquired lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:59:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:59:44 user nova-compute[70645]: INFO nova.compute.manager [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Rescuing
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquired lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating instance_info_cache with network_info: [{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Releasing lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG os_brick.utils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b74becf-7ca1-400d-9208-540dbfc18025]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5896c7-d809-424b-8d77-d46dac25ea16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6318bde1-8db2-4600-9718-5d3d8d2cf0b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9836dc9-9adc-48e3-bda3-2f70634d259b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 14:59:44 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 14:59:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[684d810a-f660-4170-ab34-20a211ee4319]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 14:59:44 user nova-compute[70645]: DEBUG os_brick.utils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:59:45 user nova-compute[70645]: DEBUG nova.network.neutron [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Updating instance_info_cache with network_info: [{"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 14:59:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Releasing lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 14:59:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-2eb87e9e-f2ac-4834-831c-4e799100a6c4 req-12348caa-51f1-4fc3-9bf9-5dbd92f06b0b service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received event network-vif-unplugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2eb87e9e-f2ac-4834-831c-4e799100a6c4 req-12348caa-51f1-4fc3-9bf9-5dbd92f06b0b service nova] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2eb87e9e-f2ac-4834-831c-4e799100a6c4 req-12348caa-51f1-4fc3-9bf9-5dbd92f06b0b service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2eb87e9e-f2ac-4834-831c-4e799100a6c4 req-12348caa-51f1-4fc3-9bf9-5dbd92f06b0b service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-2eb87e9e-f2ac-4834-831c-4e799100a6c4 req-12348caa-51f1-4fc3-9bf9-5dbd92f06b0b service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] No waiting events found dispatching network-vif-unplugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:45 user nova-compute[70645]: WARNING nova.compute.manager [req-2eb87e9e-f2ac-4834-831c-4e799100a6c4 req-12348caa-51f1-4fc3-9bf9-5dbd92f06b0b service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received unexpected event network-vif-unplugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 for instance with vm_state active and task_state rescuing.
Jul 24 14:59:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Instance destroyed successfully.
Jul 24 14:59:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Attempting rescue
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70645) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Instance directory exists: not creating {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 14:59:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Creating image(s)
Jul 24 14:59:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'trusted_certs' on Instance uuid cf8bcde0-6825-45f0-85c3-14188211558c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue" returned: 0 in 0.054s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'migration_context' on Instance uuid cf8bcde0-6825-45f0-85c3-14188211558c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Start _get_guest_xml network_info=[{"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "vif_mac": "fa:16:3e:f2:f0:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'resources' on Instance uuid cf8bcde0-6825-45f0-85c3-14188211558c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'numa_topology' on Instance uuid cf8bcde0-6825-45f0-85c3-14188211558c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:46 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:59:46 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'vcpu_model' on Instance uuid cf8bcde0-6825-45f0-85c3-14188211558c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-999275839',display_name='tempest-ServerRescueNegativeTestJSON-server-999275839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-999275839',id=20,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-wjnojzx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:58:04Z,user_data=None,user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=cf8bcde0-6825-45f0-85c3-14188211558c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "vif_mac": "fa:16:3e:f2:f0:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "vif_mac": "fa:16:3e:f2:f0:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:f0:91,bridge_name='br-int',has_traffic_filtering=True,id=a192fa1c-1413-4f9a-bb16-8fd758373ce9,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa192fa1c-14') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'pci_devices' on Instance uuid cf8bcde0-6825-45f0-85c3-14188211558c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:59:46 user nova-compute[70645]:   <uuid>cf8bcde0-6825-45f0-85c3-14188211558c</uuid>
Jul 24 14:59:46 user nova-compute[70645]:   <name>instance-00000014</name>
Jul 24 14:59:46 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 14:59:46 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:59:46 user nova-compute[70645]:   <metadata>
Jul 24 14:59:46 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:59:46 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:59:46 user nova-compute[70645]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-999275839</nova:name>
Jul 24 14:59:46 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:59:46</nova:creationTime>
Jul 24 14:59:46 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 14:59:46 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 14:59:46 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 14:59:46 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:59:46 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:59:46 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:59:46 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:59:46 user nova-compute[70645]:       <nova:owner>
Jul 24 14:59:46 user nova-compute[70645]:         <nova:user uuid="74440f1d0cf141fdb6b40b0d1e3a5d13">tempest-ServerRescueNegativeTestJSON-1652524619-project-member</nova:user>
Jul 24 14:59:46 user nova-compute[70645]:         <nova:project uuid="c3f8500e5a144902be74f12f3caf8ae2">tempest-ServerRescueNegativeTestJSON-1652524619</nova:project>
Jul 24 14:59:46 user nova-compute[70645]:       </nova:owner>
Jul 24 14:59:46 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:59:46 user nova-compute[70645]:       <nova:ports>
Jul 24 14:59:46 user nova-compute[70645]:         <nova:port uuid="a192fa1c-1413-4f9a-bb16-8fd758373ce9">
Jul 24 14:59:46 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 14:59:46 user nova-compute[70645]:         </nova:port>
Jul 24 14:59:46 user nova-compute[70645]:       </nova:ports>
Jul 24 14:59:46 user nova-compute[70645]:     </nova:instance>
Jul 24 14:59:46 user nova-compute[70645]:   </metadata>
Jul 24 14:59:46 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:59:46 user nova-compute[70645]:     <system>
Jul 24 14:59:46 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:59:46 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:59:46 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:59:46 user nova-compute[70645]:       <entry name="serial">cf8bcde0-6825-45f0-85c3-14188211558c</entry>
Jul 24 14:59:46 user nova-compute[70645]:       <entry name="uuid">cf8bcde0-6825-45f0-85c3-14188211558c</entry>
Jul 24 14:59:46 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:59:46 user nova-compute[70645]:     </system>
Jul 24 14:59:46 user nova-compute[70645]:   </sysinfo>
Jul 24 14:59:46 user nova-compute[70645]:   <os>
Jul 24 14:59:46 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:59:46 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:59:46 user nova-compute[70645]:   </os>
Jul 24 14:59:46 user nova-compute[70645]:   <features>
Jul 24 14:59:46 user nova-compute[70645]:     <acpi/>
Jul 24 14:59:46 user nova-compute[70645]:     <apic/>
Jul 24 14:59:46 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:59:46 user nova-compute[70645]:   </features>
Jul 24 14:59:46 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:59:46 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:59:46 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:59:46 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:59:46 user nova-compute[70645]:   </clock>
Jul 24 14:59:46 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:59:46 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:59:46 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:59:46 user nova-compute[70645]:   </cpu>
Jul 24 14:59:46 user nova-compute[70645]:   <devices>
Jul 24 14:59:46 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:59:46 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:59:46 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue"/>
Jul 24 14:59:46 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:59:46 user nova-compute[70645]:     </disk>
Jul 24 14:59:46 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:59:46 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:59:46 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk"/>
Jul 24 14:59:46 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 14:59:46 user nova-compute[70645]:     </disk>
Jul 24 14:59:46 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:59:46 user nova-compute[70645]:       <mac address="fa:16:3e:f2:f0:91"/>
Jul 24 14:59:46 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:59:46 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:59:46 user nova-compute[70645]:       <target dev="tapa192fa1c-14"/>
Jul 24 14:59:46 user nova-compute[70645]:     </interface>
Jul 24 14:59:46 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:59:46 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/console.log" append="off"/>
Jul 24 14:59:46 user nova-compute[70645]:     </serial>
Jul 24 14:59:46 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:59:46 user nova-compute[70645]:     <video>
Jul 24 14:59:46 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:59:46 user nova-compute[70645]:     </video>
Jul 24 14:59:46 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:59:46 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:59:46 user nova-compute[70645]:     </rng>
Jul 24 14:59:46 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:59:46 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:59:46 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:59:46 user nova-compute[70645]:     </memballoon>
Jul 24 14:59:46 user nova-compute[70645]:   </devices>
Jul 24 14:59:46 user nova-compute[70645]: </domain>
Jul 24 14:59:46 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:59:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Instance destroyed successfully.
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No VIF found with MAC fa:16:3e:f2:f0:91, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:59:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-69857ebe-8efd-4a1f-b1b2-e5fe7701fbe2 req-a08528a9-1606-41fd-969e-8d7a7488c753 service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-69857ebe-8efd-4a1f-b1b2-e5fe7701fbe2 req-a08528a9-1606-41fd-969e-8d7a7488c753 service nova] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-69857ebe-8efd-4a1f-b1b2-e5fe7701fbe2 req-a08528a9-1606-41fd-969e-8d7a7488c753 service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-69857ebe-8efd-4a1f-b1b2-e5fe7701fbe2 req-a08528a9-1606-41fd-969e-8d7a7488c753 service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-69857ebe-8efd-4a1f-b1b2-e5fe7701fbe2 req-a08528a9-1606-41fd-969e-8d7a7488c753 service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] No waiting events found dispatching network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:47 user nova-compute[70645]: WARNING nova.compute.manager [req-69857ebe-8efd-4a1f-b1b2-e5fe7701fbe2 req-a08528a9-1606-41fd-969e-8d7a7488c753 service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received unexpected event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 for instance with vm_state active and task_state rescuing.
Jul 24 14:59:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] No waiting events found dispatching network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:49 user nova-compute[70645]: WARNING nova.compute.manager [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received unexpected event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 for instance with vm_state active and task_state rescuing.
Jul 24 14:59:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] No waiting events found dispatching network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:49 user nova-compute[70645]: WARNING nova.compute.manager [req-72b3a640-7ebe-457f-b3ef-ccd0f46c1f50 req-d4731806-ac3f-42bd-b010-db506ab2993c service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received unexpected event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 for instance with vm_state active and task_state rescuing.
Jul 24 14:59:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for cf8bcde0-6825-45f0-85c3-14188211558c due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210789.9336898, cf8bcde0-6825-45f0-85c3-14188211558c => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:59:49 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] VM Resumed (Lifecycle Event)
Jul 24 14:59:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ea158a39-d718-47a5-bac1-04fb4f48f3fa tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:59:49 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 14:59:49 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210789.9351857, cf8bcde0-6825-45f0-85c3-14188211558c => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:59:49 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] VM Started (Lifecycle Event)
Jul 24 14:59:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:59:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Starting finish_migration {{(pid=70645) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance directory exists: not creating {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 14:59:51 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Creating image(s)
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.objects.instance [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'trusted_certs' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk. size=21474836480 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk 21474836480 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk 21474836480" returned: 0 in 0.060s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Ensure instance console log exists: /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Start _get_guest_xml network_info=[{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1563413765-network", "vif_mac": "fa:16:3e:46:ef:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cc469858-3d76-44b9-aada-e61e18840319', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYVBiqzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '460ae655-2955-4a45-9b12-2a3ddd9f448b', 'attached_at': '2023-07-24T14:59:51.000000', 'detached_at': '', 'volume_id': '9814e40c-d816-44f0-9243-eb5d61f88153', 'serial': '9814e40c-d816-44f0-9243-eb5d61f88153'}, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 14:59:51 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:59:51 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.objects.instance [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'vcpu_model' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYVBiqzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 14:59:51 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:59:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:59:51 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 14:59:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 14:59:51 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96799b9-65d7-469d-9267-b29608831f1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 14:59:51 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9823d50-725f-407b-b04f-1430e58cacc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153] added
Jul 24 14:59:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf59145-8f04-4fb2-82e8-756ddb943135]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa5c1b5-3c6f-48b8-b7d7-5c8fa0a14175]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYVBiqzZ {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYVBiqzZ" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22882a4-3872-49ae-809b-425777fd1c14]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYVBiqzZ'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d929dbec-e251-4f42-96d0-b9f71433896c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6bb86d-57ca-41c2-9114-817daba30467]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:59:52 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:59:52 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[762164cc-9995-4526-a877-0688bbfb2d19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]
Jul 24 14:59:52 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.
Jul 24 14:59:52 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0776675b-93ce-4142-89d9-242876f01bb4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b4321c-c324-4f4c-842a-f70962168268]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:59:52 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 14:59:52 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 14:59:52 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 14:59:52 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd158942-52ab-4f99-b582-da6f039bbd86]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:59:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYVBiqzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23364316336366339', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364316336366339', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887972996',display_name='tempest-ServerActionsTestOtherB-server-1887972996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887972996',id=14,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMleqYhBZCEEjJJsaMEuckPLdRSggssXX58+jSUDWV4RWgJi1aCvZ7GKXmFcDgd20RUebLSGWW0+tvwfBRktv2c+QmVz9Ve3ikoCtp5+5Q7Q8T6xY4TIWukXrdzPtz1wFA==',key_name='tempest-keypair-1765023642',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a7fb98af2b84c51a448d39d957f5f6a',ramdisk_id='',reservation_id='r-fex15wu9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-589948319',owner_user_name='tempest-ServerActionsTestOtherB-589948319-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01c8ead2665a44c8a24dd89ee3b18a72',uuid=460ae655-2955-4a45-9b12-2a3ddd9f448b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1563413765-network", "vif_mac": "fa:16:3e:46:ef:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converting VIF {"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1563413765-network", "vif_mac": "fa:16:3e:46:ef:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 14:59:53 user nova-compute[70645]:   <uuid>460ae655-2955-4a45-9b12-2a3ddd9f448b</uuid>
Jul 24 14:59:53 user nova-compute[70645]:   <name>instance-0000000e</name>
Jul 24 14:59:53 user nova-compute[70645]:   <memory>2097152</memory>
Jul 24 14:59:53 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 14:59:53 user nova-compute[70645]:   <metadata>
Jul 24 14:59:53 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 14:59:53 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 14:59:53 user nova-compute[70645]:       <nova:name>tempest-ServerActionsTestOtherB-server-1887972996</nova:name>
Jul 24 14:59:53 user nova-compute[70645]:       <nova:creationTime>2023-07-24 14:59:51</nova:creationTime>
Jul 24 14:59:53 user nova-compute[70645]:       <nova:flavor name="m1.small">
Jul 24 14:59:53 user nova-compute[70645]:         <nova:memory>2048</nova:memory>
Jul 24 14:59:53 user nova-compute[70645]:         <nova:disk>20</nova:disk>
Jul 24 14:59:53 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 14:59:53 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 14:59:53 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 14:59:53 user nova-compute[70645]:       </nova:flavor>
Jul 24 14:59:53 user nova-compute[70645]:       <nova:owner>
Jul 24 14:59:53 user nova-compute[70645]:         <nova:user uuid="01c8ead2665a44c8a24dd89ee3b18a72">tempest-ServerActionsTestOtherB-589948319-project-member</nova:user>
Jul 24 14:59:53 user nova-compute[70645]:         <nova:project uuid="6a7fb98af2b84c51a448d39d957f5f6a">tempest-ServerActionsTestOtherB-589948319</nova:project>
Jul 24 14:59:53 user nova-compute[70645]:       </nova:owner>
Jul 24 14:59:53 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 14:59:53 user nova-compute[70645]:       <nova:ports>
Jul 24 14:59:53 user nova-compute[70645]:         <nova:port uuid="3a56f8d6-1f50-46b0-949f-a64d933dd392">
Jul 24 14:59:53 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 14:59:53 user nova-compute[70645]:         </nova:port>
Jul 24 14:59:53 user nova-compute[70645]:       </nova:ports>
Jul 24 14:59:53 user nova-compute[70645]:     </nova:instance>
Jul 24 14:59:53 user nova-compute[70645]:   </metadata>
Jul 24 14:59:53 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 14:59:53 user nova-compute[70645]:     <system>
Jul 24 14:59:53 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 14:59:53 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 14:59:53 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 14:59:53 user nova-compute[70645]:       <entry name="serial">460ae655-2955-4a45-9b12-2a3ddd9f448b</entry>
Jul 24 14:59:53 user nova-compute[70645]:       <entry name="uuid">460ae655-2955-4a45-9b12-2a3ddd9f448b</entry>
Jul 24 14:59:53 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 14:59:53 user nova-compute[70645]:     </system>
Jul 24 14:59:53 user nova-compute[70645]:   </sysinfo>
Jul 24 14:59:53 user nova-compute[70645]:   <os>
Jul 24 14:59:53 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 14:59:53 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 14:59:53 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 14:59:53 user nova-compute[70645]:   </os>
Jul 24 14:59:53 user nova-compute[70645]:   <features>
Jul 24 14:59:53 user nova-compute[70645]:     <acpi/>
Jul 24 14:59:53 user nova-compute[70645]:     <apic/>
Jul 24 14:59:53 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 14:59:53 user nova-compute[70645]:   </features>
Jul 24 14:59:53 user nova-compute[70645]:   <clock offset="utc">
Jul 24 14:59:53 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 14:59:53 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 14:59:53 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 14:59:53 user nova-compute[70645]:   </clock>
Jul 24 14:59:53 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 14:59:53 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 14:59:53 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 14:59:53 user nova-compute[70645]:   </cpu>
Jul 24 14:59:53 user nova-compute[70645]:   <devices>
Jul 24 14:59:53 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 14:59:53 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 14:59:53 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk"/>
Jul 24 14:59:53 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 14:59:53 user nova-compute[70645]:     </disk>
Jul 24 14:59:53 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 14:59:53 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 14:59:53 user nova-compute[70645]:       <source dev="/dev/sdb"/>
Jul 24 14:59:53 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 14:59:53 user nova-compute[70645]:       <serial>9814e40c-d816-44f0-9243-eb5d61f88153</serial>
Jul 24 14:59:53 user nova-compute[70645]:     </disk>
Jul 24 14:59:53 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 14:59:53 user nova-compute[70645]:       <mac address="fa:16:3e:46:ef:9d"/>
Jul 24 14:59:53 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:59:53 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 14:59:53 user nova-compute[70645]:       <target dev="tap3a56f8d6-1f"/>
Jul 24 14:59:53 user nova-compute[70645]:     </interface>
Jul 24 14:59:53 user nova-compute[70645]:     <serial type="pty">
Jul 24 14:59:53 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/console.log" append="off"/>
Jul 24 14:59:53 user nova-compute[70645]:     </serial>
Jul 24 14:59:53 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 14:59:53 user nova-compute[70645]:     <video>
Jul 24 14:59:53 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 14:59:53 user nova-compute[70645]:     </video>
Jul 24 14:59:53 user nova-compute[70645]:     <rng model="virtio">
Jul 24 14:59:53 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 14:59:53 user nova-compute[70645]:     </rng>
Jul 24 14:59:53 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 14:59:53 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 14:59:53 user nova-compute[70645]:       <stats period="10"/>
Jul 24 14:59:53 user nova-compute[70645]:     </memballoon>
Jul 24 14:59:53 user nova-compute[70645]:   </devices>
Jul 24 14:59:53 user nova-compute[70645]: </domain>
Jul 24 14:59:53 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887972996',display_name='tempest-ServerActionsTestOtherB-server-1887972996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887972996',id=14,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMleqYhBZCEEjJJsaMEuckPLdRSggssXX58+jSUDWV4RWgJi1aCvZ7GKXmFcDgd20RUebLSGWW0+tvwfBRktv2c+QmVz9Ve3ikoCtp5+5Q7Q8T6xY4TIWukXrdzPtz1wFA==',key_name='tempest-keypair-1765023642',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a7fb98af2b84c51a448d39d957f5f6a',ramdisk_id='',reservation_id='r-fex15wu9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-589948319',owner_user_name='tempest-ServerActionsTestOtherB-589948319-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01c8ead2665a44c8a24dd89ee3b18a72',uuid=460ae655-2955-4a45-9b12-2a3ddd9f448b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1563413765-network", "vif_mac": "fa:16:3e:46:ef:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converting VIF {"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1563413765-network", "vif_mac": "fa:16:3e:46:ef:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG os_vif [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a56f8d6-1f, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a56f8d6-1f, col_values=(('external_ids', {'iface-id': '3a56f8d6-1f50-46b0-949f-a64d933dd392', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:ef:9d', 'vm-uuid': '460ae655-2955-4a45-9b12-2a3ddd9f448b'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:53 user nova-compute[70645]: INFO os_vif [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f')
Jul 24 14:59:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 14:59:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] No VIF found with MAC fa:16:3e:46:ef:9d, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 14:59:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-ddcbf937-e37d-4941-a468-627bb670b0c1 req-a040809a-d40b-4961-8d14-ae1ffb3e4b5c service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ddcbf937-e37d-4941-a468-627bb670b0c1 req-a040809a-d40b-4961-8d14-ae1ffb3e4b5c service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ddcbf937-e37d-4941-a468-627bb670b0c1 req-a040809a-d40b-4961-8d14-ae1ffb3e4b5c service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ddcbf937-e37d-4941-a468-627bb670b0c1 req-a040809a-d40b-4961-8d14-ae1ffb3e4b5c service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-ddcbf937-e37d-4941-a468-627bb670b0c1 req-a040809a-d40b-4961-8d14-ae1ffb3e4b5c service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:54 user nova-compute[70645]: WARNING nova.compute.manager [req-ddcbf937-e37d-4941-a468-627bb670b0c1 req-a040809a-d40b-4961-8d14-ae1ffb3e4b5c service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received unexpected event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with vm_state active and task_state resize_finish.
Jul 24 14:59:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:56 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210781.70787, 460ae655-2955-4a45-9b12-2a3ddd9f448b => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:59:56 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] VM Stopped (Lifecycle Event)
Jul 24 14:59:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-84909b37-e78a-48d3-a3d7-24b25730ad2c None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:56 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210796.9096098, 460ae655-2955-4a45-9b12-2a3ddd9f448b => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:59:56 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] VM Resumed (Lifecycle Event)
Jul 24 14:59:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 14:59:56 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance running successfully.
Jul 24 14:59:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Failed to set time: agent not configured {{(pid=70645) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 24 14:59:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a06e74e7-c9d4-4fb8-9d2c-7b8f9e7e9a43 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] finish_migration finished successfully. {{(pid=70645) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 24 14:59:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:59:56 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 14:59:56 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210796.914033, 460ae655-2955-4a45-9b12-2a3ddd9f448b => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 14:59:56 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] VM Started (Lifecycle Event)
Jul 24 14:59:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 14:59:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-49515572-21df-4fe1-a974-8a672effa162 req-4c30553e-9e53-4b8d-8261-ea3b7c7acd99 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 14:59:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-49515572-21df-4fe1-a974-8a672effa162 req-4c30553e-9e53-4b8d-8261-ea3b7c7acd99 service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 14:59:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-49515572-21df-4fe1-a974-8a672effa162 req-4c30553e-9e53-4b8d-8261-ea3b7c7acd99 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 14:59:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-49515572-21df-4fe1-a974-8a672effa162 req-4c30553e-9e53-4b8d-8261-ea3b7c7acd99 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 14:59:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-49515572-21df-4fe1-a974-8a672effa162 req-4c30553e-9e53-4b8d-8261-ea3b7c7acd99 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 14:59:57 user nova-compute[70645]: WARNING nova.compute.manager [req-49515572-21df-4fe1-a974-8a672effa162 req-4c30553e-9e53-4b8d-8261-ea3b7c7acd99 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received unexpected event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with vm_state active and task_state resize_finish.
Jul 24 14:59:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 14:59:57 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 14:59:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 14:59:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-6ebb6ab9-ec21-4a3b-906b-275d9afec310 req-05c45666-9681-4580-ac14-5aefd7fdce2d service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-changed-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-6ebb6ab9-ec21-4a3b-906b-275d9afec310 req-05c45666-9681-4580-ac14-5aefd7fdce2d service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Refreshing instance network info cache due to event network-changed-84e43646-0d11-4aad-8ace-40d9d0d4aacc. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:00:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6ebb6ab9-ec21-4a3b-906b-275d9afec310 req-05c45666-9681-4580-ac14-5aefd7fdce2d service nova] Acquiring lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:00:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6ebb6ab9-ec21-4a3b-906b-275d9afec310 req-05c45666-9681-4580-ac14-5aefd7fdce2d service nova] Acquired lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:00:06 user nova-compute[70645]: DEBUG nova.network.neutron [req-6ebb6ab9-ec21-4a3b-906b-275d9afec310 req-05c45666-9681-4580-ac14-5aefd7fdce2d service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Refreshing network info cache for port 84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:00:07 user nova-compute[70645]: DEBUG nova.network.neutron [req-6ebb6ab9-ec21-4a3b-906b-275d9afec310 req-05c45666-9681-4580-ac14-5aefd7fdce2d service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updated VIF entry in instance network info cache for port 84e43646-0d11-4aad-8ace-40d9d0d4aacc. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:00:07 user nova-compute[70645]: DEBUG nova.network.neutron [req-6ebb6ab9-ec21-4a3b-906b-275d9afec310 req-05c45666-9681-4580-ac14-5aefd7fdce2d service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updating instance_info_cache with network_info: [{"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:00:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6ebb6ab9-ec21-4a3b-906b-275d9afec310 req-05c45666-9681-4580-ac14-5aefd7fdce2d service nova] Releasing lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:00:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG nova.objects.instance [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'flavor' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:09 user nova-compute[70645]: INFO nova.compute.manager [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Attaching volume 59b95f50-3060-48ab-b66b-9465011bb8f7 to /dev/vdb
Jul 24 15:00:09 user nova-compute[70645]: DEBUG os_brick.utils [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9fa8f8-0d90-426a-b8ca-7359c3297cf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b505eed-7b47-4803-8fc3-952b05f50955]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e76bbd3-e5be-4215-9368-db1cb4a96016]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f8d92f-3bfc-4b37-b0d4-4fa46156a712]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:00:09 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:00:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0da931-0d6b-4a22-af60-084a4786d689]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG os_brick.utils [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:00:09 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updating existing volume attachment record: 492ce734-b571-4b49-9b10-075e1ef95edd {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:00:11 user nova-compute[70645]: DEBUG nova.compute.manager [req-fda6aa31-d2df-40b8-9c0a-01f980b0f24d req-74b4286d-85a8-4a48-a9f0-83baf5c777dd service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-changed-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:11 user nova-compute[70645]: DEBUG nova.compute.manager [req-fda6aa31-d2df-40b8-9c0a-01f980b0f24d req-74b4286d-85a8-4a48-a9f0-83baf5c777dd service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Refreshing instance network info cache due to event network-changed-634fb15f-19aa-462c-931b-dd76f2ce93b0. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:00:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fda6aa31-d2df-40b8-9c0a-01f980b0f24d req-74b4286d-85a8-4a48-a9f0-83baf5c777dd service nova] Acquiring lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:00:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fda6aa31-d2df-40b8-9c0a-01f980b0f24d req-74b4286d-85a8-4a48-a9f0-83baf5c777dd service nova] Acquired lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:00:11 user nova-compute[70645]: DEBUG nova.network.neutron [req-fda6aa31-d2df-40b8-9c0a-01f980b0f24d req-74b4286d-85a8-4a48-a9f0-83baf5c777dd service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Refreshing network info cache for port 634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:00:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:11 user nova-compute[70645]: INFO nova.compute.manager [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Shelving
Jul 24 15:00:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-aac27571-ab90-4349-ab77-9755b5f0e548 req-0a6f978b-0a02-4f64-ae72-2fdd3d0c0bd8 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-vif-unplugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-aac27571-ab90-4349-ab77-9755b5f0e548 req-0a6f978b-0a02-4f64-ae72-2fdd3d0c0bd8 service nova] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-aac27571-ab90-4349-ab77-9755b5f0e548 req-0a6f978b-0a02-4f64-ae72-2fdd3d0c0bd8 service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-aac27571-ab90-4349-ab77-9755b5f0e548 req-0a6f978b-0a02-4f64-ae72-2fdd3d0c0bd8 service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-aac27571-ab90-4349-ab77-9755b5f0e548 req-0a6f978b-0a02-4f64-ae72-2fdd3d0c0bd8 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] No waiting events found dispatching network-vif-unplugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:12 user nova-compute[70645]: WARNING nova.compute.manager [req-aac27571-ab90-4349-ab77-9755b5f0e548 req-0a6f978b-0a02-4f64-ae72-2fdd3d0c0bd8 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received unexpected event network-vif-unplugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc for instance with vm_state active and task_state shelving.
Jul 24 15:00:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance destroyed successfully.
Jul 24 15:00:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "c6738501-d019-48cb-b527-852fd6d61043" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "c6738501-d019-48cb-b527-852fd6d61043" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Beginning cold snapshot process
Jul 24 15:00:12 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:00:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:12 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:00:12 user nova-compute[70645]: INFO nova.compute.claims [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Claim successful on node user
Jul 24 15:00:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:12 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 15:00:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk /opt/stack/data/nova/instances/snapshots/tmpqicuq4wh/01ee17c3fac540d59404f869042d7ccb {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG nova.network.neutron [req-fda6aa31-d2df-40b8-9c0a-01f980b0f24d req-74b4286d-85a8-4a48-a9f0-83baf5c777dd service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Updated VIF entry in instance network info cache for port 634fb15f-19aa-462c-931b-dd76f2ce93b0. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG nova.network.neutron [req-fda6aa31-d2df-40b8-9c0a-01f980b0f24d req-74b4286d-85a8-4a48-a9f0-83baf5c777dd service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Updating instance_info_cache with network_info: [{"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fda6aa31-d2df-40b8-9c0a-01f980b0f24d req-74b4286d-85a8-4a48-a9f0-83baf5c777dd service nova] Releasing lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.781s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:00:13 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:00:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG nova.policy [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b715d50164af4254aecf7156d617fa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68682834554049928782963eab8ea32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk /opt/stack/data/nova/instances/snapshots/tmpqicuq4wh/01ee17c3fac540d59404f869042d7ccb" returned: 0 in 1.045s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:13 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Snapshot extracted, beginning image upload
Jul 24 15:00:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:00:13 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Creating image(s)
Jul 24 15:00:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "/opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "/opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.184s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk 1073741824" returned: 0 in 0.050s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-9639d0ff-32fd-4239-bdcb-6174973c0e80 req-a8206951-439f-43a4-9d7c-aabd4c0bfc4e service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9639d0ff-32fd-4239-bdcb-6174973c0e80 req-a8206951-439f-43a4-9d7c-aabd4c0bfc4e service nova] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9639d0ff-32fd-4239-bdcb-6174973c0e80 req-a8206951-439f-43a4-9d7c-aabd4c0bfc4e service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9639d0ff-32fd-4239-bdcb-6174973c0e80 req-a8206951-439f-43a4-9d7c-aabd4c0bfc4e service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-9639d0ff-32fd-4239-bdcb-6174973c0e80 req-a8206951-439f-43a4-9d7c-aabd4c0bfc4e service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] No waiting events found dispatching network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:14 user nova-compute[70645]: WARNING nova.compute.manager [req-9639d0ff-32fd-4239-bdcb-6174973c0e80 req-a8206951-439f-43a4-9d7c-aabd4c0bfc4e service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received unexpected event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc for instance with vm_state active and task_state shelving_image_uploading.
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.188s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Successfully created port: bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Cannot resize image /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lazy-loading 'migration_context' on Instance uuid c6738501-d019-48cb-b527-852fd6d61043 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Ensure instance console log exists: /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:15 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Successfully updated port: bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:00:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "refresh_cache-c6738501-d019-48cb-b527-852fd6d61043" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:00:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquired lock "refresh_cache-c6738501-d019-48cb-b527-852fd6d61043" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:00:15 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:00:15 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:00:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:15 user nova-compute[70645]: DEBUG nova.objects.instance [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:15 user nova-compute[70645]: INFO nova.compute.manager [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Attaching volume 05b990d4-add3-45f4-9e5d-b3c9bc168e98 to /dev/vdb
Jul 24 15:00:15 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Updating instance_info_cache with network_info: [{"id": "bde05f3b-6be8-471d-8766-735296f70bb5", "address": "fa:16:3e:0e:48:7e", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde05f3b-6b", "ovs_interfaceid": "bde05f3b-6be8-471d-8766-735296f70bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Releasing lock "refresh_cache-c6738501-d019-48cb-b527-852fd6d61043" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Instance network_info: |[{"id": "bde05f3b-6be8-471d-8766-735296f70bb5", "address": "fa:16:3e:0e:48:7e", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde05f3b-6b", "ovs_interfaceid": "bde05f3b-6be8-471d-8766-735296f70bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Start _get_guest_xml network_info=[{"id": "bde05f3b-6be8-471d-8766-735296f70bb5", "address": "fa:16:3e:0e:48:7e", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde05f3b-6b", "ovs_interfaceid": "bde05f3b-6be8-471d-8766-735296f70bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.utils [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:16 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:00:16 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1637723079',display_name='tempest-VolumesActionsTest-instance-1637723079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1637723079',id=23,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68682834554049928782963eab8ea32b',ramdisk_id='',reservation_id='r-ycfrs96m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1302908910',owner_user_name='tempest-VolumesActionsTest-1302908910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:00:14Z,user_data=None,user_id='b715d50164af4254aecf7156d617fa34',uuid=c6738501-d019-48cb-b527-852fd6d61043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bde05f3b-6be8-471d-8766-735296f70bb5", "address": "fa:16:3e:0e:48:7e", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde05f3b-6b", "ovs_interfaceid": "bde05f3b-6be8-471d-8766-735296f70bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converting VIF {"id": "bde05f3b-6be8-471d-8766-735296f70bb5", "address": "fa:16:3e:0e:48:7e", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde05f3b-6b", "ovs_interfaceid": "bde05f3b-6be8-471d-8766-735296f70bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:48:7e,bridge_name='br-int',has_traffic_filtering=True,id=bde05f3b-6be8-471d-8766-735296f70bb5,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde05f3b-6b') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lazy-loading 'pci_devices' on Instance uuid c6738501-d019-48cb-b527-852fd6d61043 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffb2b65-ee65-47f2-a683-b4fd9c3ca44a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:00:16 user nova-compute[70645]:   <uuid>c6738501-d019-48cb-b527-852fd6d61043</uuid>
Jul 24 15:00:16 user nova-compute[70645]:   <name>instance-00000017</name>
Jul 24 15:00:16 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:00:16 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:00:16 user nova-compute[70645]:   <metadata>
Jul 24 15:00:16 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:00:16 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:00:16 user nova-compute[70645]:       <nova:name>tempest-VolumesActionsTest-instance-1637723079</nova:name>
Jul 24 15:00:16 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:00:16</nova:creationTime>
Jul 24 15:00:16 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:00:16 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:00:16 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:00:16 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:00:16 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:00:16 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:00:16 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:00:16 user nova-compute[70645]:       <nova:owner>
Jul 24 15:00:16 user nova-compute[70645]:         <nova:user uuid="b715d50164af4254aecf7156d617fa34">tempest-VolumesActionsTest-1302908910-project-member</nova:user>
Jul 24 15:00:16 user nova-compute[70645]:         <nova:project uuid="68682834554049928782963eab8ea32b">tempest-VolumesActionsTest-1302908910</nova:project>
Jul 24 15:00:16 user nova-compute[70645]:       </nova:owner>
Jul 24 15:00:16 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:00:16 user nova-compute[70645]:       <nova:ports>
Jul 24 15:00:16 user nova-compute[70645]:         <nova:port uuid="bde05f3b-6be8-471d-8766-735296f70bb5">
Jul 24 15:00:16 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 15:00:16 user nova-compute[70645]:         </nova:port>
Jul 24 15:00:16 user nova-compute[70645]:       </nova:ports>
Jul 24 15:00:16 user nova-compute[70645]:     </nova:instance>
Jul 24 15:00:16 user nova-compute[70645]:   </metadata>
Jul 24 15:00:16 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:00:16 user nova-compute[70645]:     <system>
Jul 24 15:00:16 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:00:16 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:00:16 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:00:16 user nova-compute[70645]:       <entry name="serial">c6738501-d019-48cb-b527-852fd6d61043</entry>
Jul 24 15:00:16 user nova-compute[70645]:       <entry name="uuid">c6738501-d019-48cb-b527-852fd6d61043</entry>
Jul 24 15:00:16 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:00:16 user nova-compute[70645]:     </system>
Jul 24 15:00:16 user nova-compute[70645]:   </sysinfo>
Jul 24 15:00:16 user nova-compute[70645]:   <os>
Jul 24 15:00:16 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:00:16 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:00:16 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:00:16 user nova-compute[70645]:   </os>
Jul 24 15:00:16 user nova-compute[70645]:   <features>
Jul 24 15:00:16 user nova-compute[70645]:     <acpi/>
Jul 24 15:00:16 user nova-compute[70645]:     <apic/>
Jul 24 15:00:16 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:00:16 user nova-compute[70645]:   </features>
Jul 24 15:00:16 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:00:16 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:00:16 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:00:16 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:00:16 user nova-compute[70645]:   </clock>
Jul 24 15:00:16 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:00:16 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:00:16 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:00:16 user nova-compute[70645]:   </cpu>
Jul 24 15:00:16 user nova-compute[70645]:   <devices>
Jul 24 15:00:16 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:00:16 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:00:16 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk"/>
Jul 24 15:00:16 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:00:16 user nova-compute[70645]:     </disk>
Jul 24 15:00:16 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:00:16 user nova-compute[70645]:       <mac address="fa:16:3e:0e:48:7e"/>
Jul 24 15:00:16 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:00:16 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:00:16 user nova-compute[70645]:       <target dev="tapbde05f3b-6b"/>
Jul 24 15:00:16 user nova-compute[70645]:     </interface>
Jul 24 15:00:16 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:00:16 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/console.log" append="off"/>
Jul 24 15:00:16 user nova-compute[70645]:     </serial>
Jul 24 15:00:16 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:00:16 user nova-compute[70645]:     <video>
Jul 24 15:00:16 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:00:16 user nova-compute[70645]:     </video>
Jul 24 15:00:16 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:00:16 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:00:16 user nova-compute[70645]:     </rng>
Jul 24 15:00:16 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:00:16 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:00:16 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:00:16 user nova-compute[70645]:     </memballoon>
Jul 24 15:00:16 user nova-compute[70645]:   </devices>
Jul 24 15:00:16 user nova-compute[70645]: </domain>
Jul 24 15:00:16 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1637723079',display_name='tempest-VolumesActionsTest-instance-1637723079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1637723079',id=23,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68682834554049928782963eab8ea32b',ramdisk_id='',reservation_id='r-ycfrs96m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1302908910',owner_user_name='tempest-VolumesActionsTest-1302908910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:00:14Z,user_data=None,user_id='b715d50164af4254aecf7156d617fa34',uuid=c6738501-d019-48cb-b527-852fd6d61043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bde05f3b-6be8-471d-8766-735296f70bb5", "address": "fa:16:3e:0e:48:7e", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde05f3b-6b", "ovs_interfaceid": "bde05f3b-6be8-471d-8766-735296f70bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converting VIF {"id": "bde05f3b-6be8-471d-8766-735296f70bb5", "address": "fa:16:3e:0e:48:7e", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde05f3b-6b", "ovs_interfaceid": "bde05f3b-6be8-471d-8766-735296f70bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:48:7e,bridge_name='br-int',has_traffic_filtering=True,id=bde05f3b-6be8-471d-8766-735296f70bb5,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde05f3b-6b') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_vif [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:48:7e,bridge_name='br-int',has_traffic_filtering=True,id=bde05f3b-6be8-471d-8766-735296f70bb5,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde05f3b-6b') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbde05f3b-6b, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbde05f3b-6b, col_values=(('external_ids', {'iface-id': 'bde05f3b-6be8-471d-8766-735296f70bb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:48:7e', 'vm-uuid': 'c6738501-d019-48cb-b527-852fd6d61043'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea0c5dc-b56b-493b-b242-925d85568ac9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:16 user nova-compute[70645]: INFO os_vif [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:48:7e,bridge_name='br-int',has_traffic_filtering=True,id=bde05f3b-6be8-471d-8766-735296f70bb5,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde05f3b-6b')
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[da520587-1620-4b8e-8843-c88f6dea28e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[976245fa-a0a0-4437-b20e-ad97341f2a89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:00:16 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[992db65e-9288-4dcf-82cd-bef163dbe893]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.utils [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Updating existing volume attachment record: 67555386-81d6-4362-83f3-ebf0769c56bf {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] No VIF found with MAC fa:16:3e:0e:48:7e, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-75dd519c-bcac-4d2d-9b04-2b51e39f26dd req-21a7a922-306e-40d1-9a01-0395c87dfffb service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Received event network-changed-bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-75dd519c-bcac-4d2d-9b04-2b51e39f26dd req-21a7a922-306e-40d1-9a01-0395c87dfffb service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Refreshing instance network info cache due to event network-changed-bde05f3b-6be8-471d-8766-735296f70bb5. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-75dd519c-bcac-4d2d-9b04-2b51e39f26dd req-21a7a922-306e-40d1-9a01-0395c87dfffb service nova] Acquiring lock "refresh_cache-c6738501-d019-48cb-b527-852fd6d61043" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-75dd519c-bcac-4d2d-9b04-2b51e39f26dd req-21a7a922-306e-40d1-9a01-0395c87dfffb service nova] Acquired lock "refresh_cache-c6738501-d019-48cb-b527-852fd6d61043" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.network.neutron [req-75dd519c-bcac-4d2d-9b04-2b51e39f26dd req-21a7a922-306e-40d1-9a01-0395c87dfffb service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Refreshing network info cache for port bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwyAHPbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:00:16 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:00:16 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:00:16 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f46f8d-6039-4fce-8d79-5c1995e2b7ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:00:16 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:16 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Snapshot image upload complete
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9534cc-21eb-40aa-8e11-849bfc06bc4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.network.neutron [req-75dd519c-bcac-4d2d-9b04-2b51e39f26dd req-21a7a922-306e-40d1-9a01-0395c87dfffb service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Updated VIF entry in instance network info cache for port bde05f3b-6be8-471d-8766-735296f70bb5. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG nova.network.neutron [req-75dd519c-bcac-4d2d-9b04-2b51e39f26dd req-21a7a922-306e-40d1-9a01-0395c87dfffb service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Updating instance_info_cache with network_info: [{"id": "bde05f3b-6be8-471d-8766-735296f70bb5", "address": "fa:16:3e:0e:48:7e", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde05f3b-6b", "ovs_interfaceid": "bde05f3b-6be8-471d-8766-735296f70bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7] added
Jul 24 15:00:16 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-75dd519c-bcac-4d2d-9b04-2b51e39f26dd req-21a7a922-306e-40d1-9a01-0395c87dfffb service nova] Releasing lock "refresh_cache-c6738501-d019-48cb-b527-852fd6d61043" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47bcbc1-e0d0-4787-bd02-a18af95acbde]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[522b07c3-527f-4a0e-a2ee-870f36d2f6e1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwyAHPbs {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwyAHPbs" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce92cf51-497c-455d-9db2-5a119a14b779]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VwyAHPbs'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:17 user nova-compute[70645]: INFO nova.compute.manager [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Shelve offloading
Jul 24 15:00:17 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance destroyed successfully.
Jul 24 15:00:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[242565a0-74d2-4d06-9992-d2c8e7e83793]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquired lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f5192d-2abd-41dc-a27d-09868dbe66c9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:17 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:17 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:17 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:17 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e7f7ea-a125-434b-86e4-81f3ffe56c1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260]
Jul 24 15:00:17 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260] successful.
Jul 24 15:00:17 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6720c0b8-f25d-4a88-a9ce-3e8bf2080311]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a585b7-b302-4f1a-9ea4-1f39c9dd0f06]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:17 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:17 user nova-compute[70645]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:00:17 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:17 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:17 user nova-compute[70645]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:00:17 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79820d1-734d-45b2-b4fc-a10ef4e7d07d]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwyAHPbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updating instance_info_cache with network_info: [{"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Releasing lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:17 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-37693897-8d21-4cba-81bb-c1cdbd5a805d req-0a61ebc3-3da9-4c41-9c89-07fb05ddf9c8 service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Received event network-vif-plugged-bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-37693897-8d21-4cba-81bb-c1cdbd5a805d req-0a61ebc3-3da9-4c41-9c89-07fb05ddf9c8 service nova] Acquiring lock "c6738501-d019-48cb-b527-852fd6d61043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-37693897-8d21-4cba-81bb-c1cdbd5a805d req-0a61ebc3-3da9-4c41-9c89-07fb05ddf9c8 service nova] Lock "c6738501-d019-48cb-b527-852fd6d61043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-37693897-8d21-4cba-81bb-c1cdbd5a805d req-0a61ebc3-3da9-4c41-9c89-07fb05ddf9c8 service nova] Lock "c6738501-d019-48cb-b527-852fd6d61043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-37693897-8d21-4cba-81bb-c1cdbd5a805d req-0a61ebc3-3da9-4c41-9c89-07fb05ddf9c8 service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] No waiting events found dispatching network-vif-plugged-bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:18 user nova-compute[70645]: WARNING nova.compute.manager [req-37693897-8d21-4cba-81bb-c1cdbd5a805d req-0a61ebc3-3da9-4c41-9c89-07fb05ddf9c8 service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Received unexpected event network-vif-plugged-bde05f3b-6be8-471d-8766-735296f70bb5 for instance with vm_state building and task_state spawning.
Jul 24 15:00:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23237643833346236', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237643833346236', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.objects.instance [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'flavor' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:00:18 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:00:18 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:00:18 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:00:18 user nova-compute[70645]:   <serial>59b95f50-3060-48ab-b66b-9465011bb8f7</serial>
Jul 24 15:00:18 user nova-compute[70645]: </disk>
Jul 24 15:00:18 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:18 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance destroyed successfully.
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'resources' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1918489519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1918489519',id=21,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy5TsjK5j9HCl9mLdX6AaZM+2QGOGiecv426IZtv6DpfNck1CagDBFF7p/xYc78uCqhIY0GMZJHT90HiD7ZmVpYpGtK6yNYvpcTLHn4cg/C/ja0/grJ5zcOTPgsQ91Ggg==',key_name='tempest-keypair-2073152801',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-gcl1160i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member',shelved_at='2023-07-24T15:00:16.913945',shelved_host='user',shelved_image_id='ccfae695-e065-4342-adbe-fee99b0c1dac'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=9ea99927-77d9-4e98-b435-d4c781031d90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG os_vif [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-b75ef52f-b71f-4953-8de3-9debeaef0906 req-154242f6-e3a8-4aee-bf3c-d2b254cfe3b8 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-changed-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-b75ef52f-b71f-4953-8de3-9debeaef0906 req-154242f6-e3a8-4aee-bf3c-d2b254cfe3b8 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Refreshing instance network info cache due to event network-changed-84e43646-0d11-4aad-8ace-40d9d0d4aacc. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b75ef52f-b71f-4953-8de3-9debeaef0906 req-154242f6-e3a8-4aee-bf3c-d2b254cfe3b8 service nova] Acquiring lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b75ef52f-b71f-4953-8de3-9debeaef0906 req-154242f6-e3a8-4aee-bf3c-d2b254cfe3b8 service nova] Acquired lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.network.neutron [req-b75ef52f-b71f-4953-8de3-9debeaef0906 req-154242f6-e3a8-4aee-bf3c-d2b254cfe3b8 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Refreshing network info cache for port 84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84e43646-0d, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:00:18 user nova-compute[70645]: INFO os_vif [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d')
Jul 24 15:00:18 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Deleting instance files /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90_del
Jul 24 15:00:18 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Deletion of /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90_del complete
Jul 24 15:00:18 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Deleted allocations for instance 9ea99927-77d9-4e98-b435-d4c781031d90
Jul 24 15:00:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No VIF found with MAC fa:16:3e:c0:95:67, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a1867f6c-3f41-4da0-80fa-1e00dd0d0cd8 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.567s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG nova.network.neutron [req-b75ef52f-b71f-4953-8de3-9debeaef0906 req-154242f6-e3a8-4aee-bf3c-d2b254cfe3b8 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updated VIF entry in instance network info cache for port 84e43646-0d11-4aad-8ace-40d9d0d4aacc. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG nova.network.neutron [req-b75ef52f-b71f-4953-8de3-9debeaef0906 req-154242f6-e3a8-4aee-bf3c-d2b254cfe3b8 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updating instance_info_cache with network_info: [{"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap84e43646-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b75ef52f-b71f-4953-8de3-9debeaef0906 req-154242f6-e3a8-4aee-bf3c-d2b254cfe3b8 service nova] Releasing lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c23c0578-de5c-4889-8958-d77e82ff51a7 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.863s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:19 user nova-compute[70645]: INFO nova.compute.manager [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Rebuilding instance
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'trusted_certs' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-7d2345c3-bd2c-4ff0-9c7c-abeb3629d9f4 req-058764d7-21e3-4d45-b5da-eb082c3aef22 service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Received event network-vif-plugged-bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7d2345c3-bd2c-4ff0-9c7c-abeb3629d9f4 req-058764d7-21e3-4d45-b5da-eb082c3aef22 service nova] Acquiring lock "c6738501-d019-48cb-b527-852fd6d61043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7d2345c3-bd2c-4ff0-9c7c-abeb3629d9f4 req-058764d7-21e3-4d45-b5da-eb082c3aef22 service nova] Lock "c6738501-d019-48cb-b527-852fd6d61043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7d2345c3-bd2c-4ff0-9c7c-abeb3629d9f4 req-058764d7-21e3-4d45-b5da-eb082c3aef22 service nova] Lock "c6738501-d019-48cb-b527-852fd6d61043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-7d2345c3-bd2c-4ff0-9c7c-abeb3629d9f4 req-058764d7-21e3-4d45-b5da-eb082c3aef22 service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] No waiting events found dispatching network-vif-plugged-bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:20 user nova-compute[70645]: WARNING nova.compute.manager [req-7d2345c3-bd2c-4ff0-9c7c-abeb3629d9f4 req-058764d7-21e3-4d45-b5da-eb082c3aef22 service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Received unexpected event network-vif-plugged-bde05f3b-6be8-471d-8766-735296f70bb5 for instance with vm_state building and task_state spawning.
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210820.0755322, c6738501-d019-48cb-b527-852fd6d61043 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:00:20 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c6738501-d019-48cb-b527-852fd6d61043] VM Resumed (Lifecycle Event)
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: c6738501-d019-48cb-b527-852fd6d61043] Instance spawned successfully.
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c6738501-d019-48cb-b527-852fd6d61043] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'pci_requests' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c6738501-d019-48cb-b527-852fd6d61043] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'pci_devices' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'resources' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:20 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c6738501-d019-48cb-b527-852fd6d61043] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210820.0757916, c6738501-d019-48cb-b527-852fd6d61043 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:00:20 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c6738501-d019-48cb-b527-852fd6d61043] VM Started (Lifecycle Event)
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'migration_context' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70645) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c6738501-d019-48cb-b527-852fd6d61043] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:20 user nova-compute[70645]: INFO nova.compute.manager [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Took 6.37 seconds to spawn the instance on the hypervisor.
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c6738501-d019-48cb-b527-852fd6d61043] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:20 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c6738501-d019-48cb-b527-852fd6d61043] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:00:20 user nova-compute[70645]: INFO nova.compute.manager [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Took 7.83 seconds to build instance.
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c57bec1e-fc53-4d3e-b432-db9c865d4c2e tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "c6738501-d019-48cb-b527-852fd6d61043" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.199s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Instance destroyed successfully.
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: INFO nova.compute.manager [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Detaching volume 59b95f50-3060-48ab-b66b-9465011bb8f7
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: INFO nova.virt.block_device [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Attempting to driver detach volume 59b95f50-3060-48ab-b66b-9465011bb8f7 from mountpoint /dev/vdb
Jul 24 15:00:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Attempting to detach device vdb from instance 20469e51-a240-48ea-bdf4-f7a59d129232 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:00:21 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:00:21 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:00:21 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:00:21 user nova-compute[70645]:   <serial>59b95f50-3060-48ab-b66b-9465011bb8f7</serial>
Jul 24 15:00:21 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:00:21 user nova-compute[70645]: </disk>
Jul 24 15:00:21 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:00:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Successfully detached device vdb from instance 20469e51-a240-48ea-bdf4-f7a59d129232 from the persistent domain config.
Jul 24 15:00:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwyAHPbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:00:21 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d3de78-e258-4483-bcbd-c4244521d8d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caf3905-5e26-410d-b45d-6b252f70b094]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:21 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:21 user nova-compute[70645]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:00:21 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:21 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:21 user nova-compute[70645]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:00:21 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba847be200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4bd9ca-96e7-4e87-afa3-78e648c70944]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00b5b3b-6f5f-44a0-bd8a-8ffc99ab77ce]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b853cde-2bd4-4b06-8dbe-0ba692cbd415]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f6a90f-9503-4ff5-8380-ccaf83ab8db3]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7835a05e-1030-4dbc-81c4-29c119c3d2e8]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d413308e-506c-460f-88f8-8f6d8a2df17d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260]
Jul 24 15:00:21 user nova-compute[70645]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260] successful.
Jul 24 15:00:21 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa268021-9cd4-4999-82f1-9ef0deb46c37]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== disconnect_volume: return (371ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:00:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-vif-unplugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] No waiting events found dispatching network-vif-unplugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:22 user nova-compute[70645]: WARNING nova.compute.manager [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received unexpected event network-vif-unplugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 for instance with vm_state active and task_state rebuilding.
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] No waiting events found dispatching network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:22 user nova-compute[70645]: WARNING nova.compute.manager [req-1785fdd5-850d-44fc-b5f7-0196cc0482ab req-89f83903-498d-4691-8a4b-1db4801bb269 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received unexpected event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 for instance with vm_state active and task_state rebuilding.
Jul 24 15:00:22 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:00:22 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7534MB free_disk=25.441795349121094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Applying migration context for instance 460ae655-2955-4a45-9b12-2a3ddd9f448b as it has an incoming, in-progress migration 2b4eadff-48a4-4aa1-8719-898abf635907. Migration status is finished {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 15:00:22 user nova-compute[70645]: INFO nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating resource usage from migration 2b4eadff-48a4-4aa1-8719-898abf635907
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 6fafa215-3ee5-4efb-816a-1d9f72e667da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 734abf9a-96dd-40b4-9b68-2d42fa079216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Migration 2b4eadff-48a4-4aa1-8719-898abf635907 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 460ae655-2955-4a45-9b12-2a3ddd9f448b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance c6738501-d019-48cb-b527-852fd6d61043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:00:22 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Instance destroyed successfully.
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:56:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1375956069',display_name='tempest-ServerActionsTestOtherA-server-1144815694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1375956069',id=16,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:56:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-wu79uln7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=20469e51-a240-48ea-bdf4-f7a59d129232,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG os_vif [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap254aef5a-c4, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:00:22 user nova-compute[70645]: INFO os_vif [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4')
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwyAHPbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:00:22 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 15:00:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0326e84e-5d8f-4958-94e7-3b6085be486c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[13baaa61-8fae-4ec7-be6c-f3474fa27da7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:22 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:22 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:22 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:22 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba845ed2d0>, {}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Disconnecting from: [] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== disconnect_volume: return (71ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:00:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:00:22 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Deleting instance files /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232_del
Jul 24 15:00:22 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Deletion of /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232_del complete
Jul 24 15:00:23 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.779s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:23 user nova-compute[70645]: INFO nova.virt.block_device [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Booting with volume 59b95f50-3060-48ab-b66b-9465011bb8f7 at /dev/vdb
Jul 24 15:00:23 user nova-compute[70645]: DEBUG os_brick.utils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5df8430-1857-4e8f-b6c8-54b7a9725ddc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd469eb5-aac7-4143-8cad-f4443e45ce2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1065a77-834f-4200-a4da-c03d7607eb1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[317446ba-b664-4c8c-83c5-633df1183453]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:00:23 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:00:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5227178f-5ff8-4a8f-b2a5-3b763ca7b4ef]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG os_brick.utils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:00:23 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updating existing volume attachment record: 9fdc0cc8-a271-4a1a-91a3-92e23b90b85c {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating instance_info_cache with network_info: [{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:00:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:00:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:27 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210812.4146235, 9ea99927-77d9-4e98-b435-d4c781031d90 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:00:27 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] VM Stopped (Lifecycle Event)
Jul 24 15:00:27 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3931f947-4eb0-424f-ab04-b887f14fbd85 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgHOotWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:00:29 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:00:29 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:00:29 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c32bf3-a39f-4de2-9b69-c7fd634874df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:00:29 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5c95d4-48da-4637-8a97-8141528ca1bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98] added
Jul 24 15:00:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[160c8443-2ece-4986-9eb4-583e063478b9]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df30728-f26b-4874-bbac-934f7ccfd891]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgHOotWJ {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgHOotWJ" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64d3fa0-2354-4924-b6b6-b4a0770b04ee]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xgHOotWJ'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a5e251-1f52-4bbb-9989-d3d5aa73bc43]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8e3534-de43-46ae-b442-9d528f4f5670]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:29 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:29 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef58b6b1-1358-4340-918f-e857efce6b20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260]
Jul 24 15:00:29 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260] successful.
Jul 24 15:00:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57f3809-010c-4a70-96a0-9d1491a991cb]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[da96fbab-d4bc-4ecd-867d-bdf2754ffcda]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:29 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:29 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:00:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:29 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:29 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:00:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5f03f2-1b81-4b45-8411-636a39c996a4]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:00:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgHOotWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26537383530633466', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537383530633466', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG nova.objects.instance [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:00:30 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:00:30 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:00:30 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:00:30 user nova-compute[70645]:   <serial>05b990d4-add3-45f4-9e5d-b3c9bc168e98</serial>
Jul 24 15:00:30 user nova-compute[70645]: </disk>
Jul 24 15:00:30 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:00:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Creating image(s)
Jul 24 15:00:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "/opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "/opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "/opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.127s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.129s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk 1073741824" returned: 0 in 0.047s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No VIF found with MAC fa:16:3e:c7:b9:c5, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45995dcd-7121-4c15-a71a-ba74c289a04a tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.437s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Cannot resize image /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Ensure instance console log exists: /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Start _get_guest_xml network_info=[{"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9fdc0cc8-a271-4a1a-91a3-92e23b90b85c', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwyAHPbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20469e51-a240-48ea-bdf4-f7a59d129232', 'attached_at': '', 'detached_at': '', 'volume_id': '59b95f50-3060-48ab-b66b-9465011bb8f7', 'serial': '59b95f50-3060-48ab-b66b-9465011bb8f7'}, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:00:31 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 15:00:31 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'vcpu_model' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwyAHPbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:00:31 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:00:31 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:00:31 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ba93b6-75e4-403c-a901-1fa83c7316e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:00:31 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4913890a-9932-4aa4-aa72-9504bb8ae23c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7] added
Jul 24 15:00:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c37dc0-5c6c-4a8a-896c-2f68efa8a154]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f70a1e6-3fba-4e0a-a5b0-6c7c4d0082e3]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwyAHPbs {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwyAHPbs" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[218cd8c1-ebb4-4321-bc1c-9cab6621ee1c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VwyAHPbs'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8037ca8a-dde1-4d9e-abe6-82c9f9112b55]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6760b22-b5f1-4606-823c-1b6031718938]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea983fa-95d3-41e2-9943-e0ac5f0264d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260]
Jul 24 15:00:31 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260] successful.
Jul 24 15:00:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.080s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f69742-6ace-4ce1-af57-60fb780293a1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd3ed7d-81b0-44ce-a370-81fc04d1b899]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:00:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eccb9d-7bca-452f-ac38-ca61f4f216b1]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:00:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwyAHPbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f90acef-12a3-46da-bd9c-6135934bc0b3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f90acef-12a3-46da-bd9c-6135934bc0b3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0f90acef-12a3-46da-bd9c-6135934bc0b3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0f90acef-12a3-46da-bd9c-6135934bc0b3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70645) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0f90acef-12a3-46da-bd9c-6135934bc0b3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-7192ec3f-1ef3-4763-8b37-fc9257d9a16e req-c2b725bf-5f53-4267-aa82-5418b4b6f964 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7192ec3f-1ef3-4763-8b37-fc9257d9a16e req-c2b725bf-5f53-4267-aa82-5418b4b6f964 service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7192ec3f-1ef3-4763-8b37-fc9257d9a16e req-c2b725bf-5f53-4267-aa82-5418b4b6f964 service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7192ec3f-1ef3-4763-8b37-fc9257d9a16e req-c2b725bf-5f53-4267-aa82-5418b4b6f964 service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-7192ec3f-1ef3-4763-8b37-fc9257d9a16e req-c2b725bf-5f53-4267-aa82-5418b4b6f964 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:32 user nova-compute[70645]: WARNING nova.compute.manager [req-7192ec3f-1ef3-4763-8b37-fc9257d9a16e req-c2b725bf-5f53-4267-aa82-5418b4b6f964 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state active and task_state powering-off.
Jul 24 15:00:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23237643833346236', 'path': '/dev/sdd'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237643833346236', 'path': '/dev/sdd'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T14:56:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1375956069',display_name='tempest-ServerActionsTestOtherA-server-1144815694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1375956069',id=16,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:56:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-wu79uln7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:00:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=20469e51-a240-48ea-bdf4-f7a59d129232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:00:32 user nova-compute[70645]:   <uuid>20469e51-a240-48ea-bdf4-f7a59d129232</uuid>
Jul 24 15:00:32 user nova-compute[70645]:   <name>instance-00000010</name>
Jul 24 15:00:32 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:00:32 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:00:32 user nova-compute[70645]:   <metadata>
Jul 24 15:00:32 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:00:32 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:00:32 user nova-compute[70645]:       <nova:name>tempest-ServerActionsTestOtherA-server-1144815694</nova:name>
Jul 24 15:00:32 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:00:31</nova:creationTime>
Jul 24 15:00:32 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:00:32 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:00:32 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:00:32 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:00:32 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:00:32 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:00:32 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:00:32 user nova-compute[70645]:       <nova:owner>
Jul 24 15:00:32 user nova-compute[70645]:         <nova:user uuid="43cd7067d09747f9b80cec22154a0e93">tempest-ServerActionsTestOtherA-1886739574-project-member</nova:user>
Jul 24 15:00:32 user nova-compute[70645]:         <nova:project uuid="f863d6c0aad845139d04b550254d59e3">tempest-ServerActionsTestOtherA-1886739574</nova:project>
Jul 24 15:00:32 user nova-compute[70645]:       </nova:owner>
Jul 24 15:00:32 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:00:32 user nova-compute[70645]:       <nova:ports>
Jul 24 15:00:32 user nova-compute[70645]:         <nova:port uuid="254aef5a-c4f8-473b-a2c0-6db998ebc479">
Jul 24 15:00:32 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 15:00:32 user nova-compute[70645]:         </nova:port>
Jul 24 15:00:32 user nova-compute[70645]:       </nova:ports>
Jul 24 15:00:32 user nova-compute[70645]:     </nova:instance>
Jul 24 15:00:32 user nova-compute[70645]:   </metadata>
Jul 24 15:00:32 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:00:32 user nova-compute[70645]:     <system>
Jul 24 15:00:32 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:00:32 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:00:32 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:00:32 user nova-compute[70645]:       <entry name="serial">20469e51-a240-48ea-bdf4-f7a59d129232</entry>
Jul 24 15:00:32 user nova-compute[70645]:       <entry name="uuid">20469e51-a240-48ea-bdf4-f7a59d129232</entry>
Jul 24 15:00:32 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:00:32 user nova-compute[70645]:     </system>
Jul 24 15:00:32 user nova-compute[70645]:   </sysinfo>
Jul 24 15:00:32 user nova-compute[70645]:   <os>
Jul 24 15:00:32 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:00:32 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:00:32 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:00:32 user nova-compute[70645]:   </os>
Jul 24 15:00:32 user nova-compute[70645]:   <features>
Jul 24 15:00:32 user nova-compute[70645]:     <acpi/>
Jul 24 15:00:32 user nova-compute[70645]:     <apic/>
Jul 24 15:00:32 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:00:32 user nova-compute[70645]:   </features>
Jul 24 15:00:32 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:00:32 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:00:32 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:00:32 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:00:32 user nova-compute[70645]:   </clock>
Jul 24 15:00:32 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:00:32 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:00:32 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:00:32 user nova-compute[70645]:   </cpu>
Jul 24 15:00:32 user nova-compute[70645]:   <devices>
Jul 24 15:00:32 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:00:32 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:00:32 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk"/>
Jul 24 15:00:32 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:00:32 user nova-compute[70645]:     </disk>
Jul 24 15:00:32 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:00:32 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:00:32 user nova-compute[70645]:       <source dev="/dev/sdd"/>
Jul 24 15:00:32 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 15:00:32 user nova-compute[70645]:       <serial>59b95f50-3060-48ab-b66b-9465011bb8f7</serial>
Jul 24 15:00:32 user nova-compute[70645]:     </disk>
Jul 24 15:00:32 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:00:32 user nova-compute[70645]:       <mac address="fa:16:3e:c0:95:67"/>
Jul 24 15:00:32 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:00:32 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:00:32 user nova-compute[70645]:       <target dev="tap254aef5a-c4"/>
Jul 24 15:00:32 user nova-compute[70645]:     </interface>
Jul 24 15:00:32 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:00:32 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/console.log" append="off"/>
Jul 24 15:00:32 user nova-compute[70645]:     </serial>
Jul 24 15:00:32 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:00:32 user nova-compute[70645]:     <video>
Jul 24 15:00:32 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:00:32 user nova-compute[70645]:     </video>
Jul 24 15:00:32 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:00:32 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:00:32 user nova-compute[70645]:     </rng>
Jul 24 15:00:32 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:00:32 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:00:32 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:00:32 user nova-compute[70645]:     </memballoon>
Jul 24 15:00:32 user nova-compute[70645]:   </devices>
Jul 24 15:00:32 user nova-compute[70645]: </domain>
Jul 24 15:00:32 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T14:56:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1375956069',display_name='tempest-ServerActionsTestOtherA-server-1144815694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1375956069',id=16,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:56:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-wu79uln7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:00:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=20469e51-a240-48ea-bdf4-f7a59d129232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG os_vif [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap254aef5a-c4, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap254aef5a-c4, col_values=(('external_ids', {'iface-id': '254aef5a-c4f8-473b-a2c0-6db998ebc479', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:95:67', 'vm-uuid': '20469e51-a240-48ea-bdf4-f7a59d129232'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:00:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:33 user nova-compute[70645]: INFO os_vif [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4')
Jul 24 15:00:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:00:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:00:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No VIF found with MAC fa:16:3e:c0:95:67, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:00:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:33 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance destroyed successfully.
Jul 24 15:00:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0f90acef-12a3-46da-bd9c-6135934bc0b3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f90acef-12a3-46da-bd9c-6135934bc0b3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.221s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:35 user nova-compute[70645]: WARNING nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state stopped and task_state None.
Jul 24 15:00:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:35 user nova-compute[70645]: WARNING nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state stopped and task_state None.
Jul 24 15:00:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:35 user nova-compute[70645]: WARNING nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state stopped and task_state None.
Jul 24 15:00:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:35 user nova-compute[70645]: WARNING nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state stopped and task_state None.
Jul 24 15:00:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:35 user nova-compute[70645]: WARNING nova.compute.manager [req-919bcf8b-f3a0-4f99-8f5b-0ac353704e52 req-b73a4cb0-e09a-44f7-a24c-0fb9f9568e9c service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state stopped and task_state None.
Jul 24 15:00:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210821.061426, 20469e51-a240-48ea-bdf4-f7a59d129232 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:00:36 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] VM Stopped (Lifecycle Event)
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ff0b1c2c-5eaf-4dfe-b465-62dbcf229505 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210836.9159665, 20469e51-a240-48ea-bdf4-f7a59d129232 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:00:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] VM Resumed (Lifecycle Event)
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:00:36 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Instance spawned successfully.
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:00:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 15:00:36 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210836.9171782, 20469e51-a240-48ea-bdf4-f7a59d129232 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:00:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] VM Started (Lifecycle Event)
Jul 24 15:00:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:37 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 15:00:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] No waiting events found dispatching network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:37 user nova-compute[70645]: WARNING nova.compute.manager [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received unexpected event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 for instance with vm_state active and task_state rebuild_spawning.
Jul 24 15:00:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] No waiting events found dispatching network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:37 user nova-compute[70645]: WARNING nova.compute.manager [req-af5558c1-4737-4652-9313-65999d1d818c req-d5543e4e-a1ec-4d92-a279-96e7f172cd86 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received unexpected event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 for instance with vm_state active and task_state rebuild_spawning.
Jul 24 15:00:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70645) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2ac8501a-2473-4bc1-9d31-c0b13f5e225f tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:48 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210833.7423224, 734abf9a-96dd-40b4-9b68-2d42fa079216 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:00:48 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] VM Stopped (Lifecycle Event)
Jul 24 15:00:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2a309d87-d0b2-4092-864e-54bf412da5be None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2a309d87-d0b2-4092-864e-54bf412da5be None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:00:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "07adce07-b416-44fb-b548-17b8cd0d8168" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "07adce07-b416-44fb-b548-17b8cd0d8168" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:00:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:00:53 user nova-compute[70645]: INFO nova.compute.claims [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Claim successful on node user
Jul 24 15:00:53 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:00:53 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:00:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.policy [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '192b7bd8dd234dceadc22ba7bb092344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab8baa391424072ba5bcea7f54f0242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:00:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Creating image(s)
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "/opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "/opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "/opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk 1073741824" returned: 0 in 0.055s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Successfully created port: 3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Cannot resize image /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'migration_context' on Instance uuid 07adce07-b416-44fb-b548-17b8cd0d8168 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Ensure instance console log exists: /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Successfully updated port: 3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "refresh_cache-07adce07-b416-44fb-b548-17b8cd0d8168" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquired lock "refresh_cache-07adce07-b416-44fb-b548-17b8cd0d8168" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-b743f79c-20bf-4384-be06-876b2e25e81d req-55830bf1-ed36-4b50-9d8e-46c791b151ac service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Received event network-changed-3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-b743f79c-20bf-4384-be06-876b2e25e81d req-55830bf1-ed36-4b50-9d8e-46c791b151ac service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Refreshing instance network info cache due to event network-changed-3258aab1-f0f0-4794-9ca4-1979321a98f0. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b743f79c-20bf-4384-be06-876b2e25e81d req-55830bf1-ed36-4b50-9d8e-46c791b151ac service nova] Acquiring lock "refresh_cache-07adce07-b416-44fb-b548-17b8cd0d8168" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Updating instance_info_cache with network_info: [{"id": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "address": "fa:16:3e:9f:16:10", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3258aab1-f0", "ovs_interfaceid": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Releasing lock "refresh_cache-07adce07-b416-44fb-b548-17b8cd0d8168" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Instance network_info: |[{"id": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "address": "fa:16:3e:9f:16:10", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3258aab1-f0", "ovs_interfaceid": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b743f79c-20bf-4384-be06-876b2e25e81d req-55830bf1-ed36-4b50-9d8e-46c791b151ac service nova] Acquired lock "refresh_cache-07adce07-b416-44fb-b548-17b8cd0d8168" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.network.neutron [req-b743f79c-20bf-4384-be06-876b2e25e81d req-55830bf1-ed36-4b50-9d8e-46c791b151ac service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Refreshing network info cache for port 3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Start _get_guest_xml network_info=[{"id": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "address": "fa:16:3e:9f:16:10", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3258aab1-f0", "ovs_interfaceid": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:00:55 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:00:55 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:00:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1648115033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1648115033',id=24,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-8kltig5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:00:54Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=07adce07-b416-44fb-b548-17b8cd0d8168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "address": "fa:16:3e:9f:16:10", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3258aab1-f0", "ovs_interfaceid": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "address": "fa:16:3e:9f:16:10", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3258aab1-f0", "ovs_interfaceid": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:16:10,bridge_name='br-int',has_traffic_filtering=True,id=3258aab1-f0f0-4794-9ca4-1979321a98f0,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3258aab1-f0') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'pci_devices' on Instance uuid 07adce07-b416-44fb-b548-17b8cd0d8168 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:00:56 user nova-compute[70645]:   <uuid>07adce07-b416-44fb-b548-17b8cd0d8168</uuid>
Jul 24 15:00:56 user nova-compute[70645]:   <name>instance-00000018</name>
Jul 24 15:00:56 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:00:56 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:00:56 user nova-compute[70645]:   <metadata>
Jul 24 15:00:56 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:00:56 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:00:56 user nova-compute[70645]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1648115033</nova:name>
Jul 24 15:00:56 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:00:55</nova:creationTime>
Jul 24 15:00:56 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:00:56 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:00:56 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:00:56 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:00:56 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:00:56 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:00:56 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:00:56 user nova-compute[70645]:       <nova:owner>
Jul 24 15:00:56 user nova-compute[70645]:         <nova:user uuid="192b7bd8dd234dceadc22ba7bb092344">tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member</nova:user>
Jul 24 15:00:56 user nova-compute[70645]:         <nova:project uuid="bab8baa391424072ba5bcea7f54f0242">tempest-ServerBootFromVolumeStableRescueTest-1550895590</nova:project>
Jul 24 15:00:56 user nova-compute[70645]:       </nova:owner>
Jul 24 15:00:56 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:00:56 user nova-compute[70645]:       <nova:ports>
Jul 24 15:00:56 user nova-compute[70645]:         <nova:port uuid="3258aab1-f0f0-4794-9ca4-1979321a98f0">
Jul 24 15:00:56 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 15:00:56 user nova-compute[70645]:         </nova:port>
Jul 24 15:00:56 user nova-compute[70645]:       </nova:ports>
Jul 24 15:00:56 user nova-compute[70645]:     </nova:instance>
Jul 24 15:00:56 user nova-compute[70645]:   </metadata>
Jul 24 15:00:56 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:00:56 user nova-compute[70645]:     <system>
Jul 24 15:00:56 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:00:56 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:00:56 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:00:56 user nova-compute[70645]:       <entry name="serial">07adce07-b416-44fb-b548-17b8cd0d8168</entry>
Jul 24 15:00:56 user nova-compute[70645]:       <entry name="uuid">07adce07-b416-44fb-b548-17b8cd0d8168</entry>
Jul 24 15:00:56 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:00:56 user nova-compute[70645]:     </system>
Jul 24 15:00:56 user nova-compute[70645]:   </sysinfo>
Jul 24 15:00:56 user nova-compute[70645]:   <os>
Jul 24 15:00:56 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:00:56 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:00:56 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:00:56 user nova-compute[70645]:   </os>
Jul 24 15:00:56 user nova-compute[70645]:   <features>
Jul 24 15:00:56 user nova-compute[70645]:     <acpi/>
Jul 24 15:00:56 user nova-compute[70645]:     <apic/>
Jul 24 15:00:56 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:00:56 user nova-compute[70645]:   </features>
Jul 24 15:00:56 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:00:56 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:00:56 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:00:56 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:00:56 user nova-compute[70645]:   </clock>
Jul 24 15:00:56 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:00:56 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:00:56 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:00:56 user nova-compute[70645]:   </cpu>
Jul 24 15:00:56 user nova-compute[70645]:   <devices>
Jul 24 15:00:56 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:00:56 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:00:56 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk"/>
Jul 24 15:00:56 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:00:56 user nova-compute[70645]:     </disk>
Jul 24 15:00:56 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:00:56 user nova-compute[70645]:       <mac address="fa:16:3e:9f:16:10"/>
Jul 24 15:00:56 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:00:56 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:00:56 user nova-compute[70645]:       <target dev="tap3258aab1-f0"/>
Jul 24 15:00:56 user nova-compute[70645]:     </interface>
Jul 24 15:00:56 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:00:56 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/console.log" append="off"/>
Jul 24 15:00:56 user nova-compute[70645]:     </serial>
Jul 24 15:00:56 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:00:56 user nova-compute[70645]:     <video>
Jul 24 15:00:56 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:00:56 user nova-compute[70645]:     </video>
Jul 24 15:00:56 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:00:56 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:00:56 user nova-compute[70645]:     </rng>
Jul 24 15:00:56 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:00:56 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:00:56 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:00:56 user nova-compute[70645]:     </memballoon>
Jul 24 15:00:56 user nova-compute[70645]:   </devices>
Jul 24 15:00:56 user nova-compute[70645]: </domain>
Jul 24 15:00:56 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1648115033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1648115033',id=24,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-8kltig5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:00:54Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=07adce07-b416-44fb-b548-17b8cd0d8168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "address": "fa:16:3e:9f:16:10", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3258aab1-f0", "ovs_interfaceid": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "address": "fa:16:3e:9f:16:10", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3258aab1-f0", "ovs_interfaceid": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:16:10,bridge_name='br-int',has_traffic_filtering=True,id=3258aab1-f0f0-4794-9ca4-1979321a98f0,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3258aab1-f0') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG os_vif [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:16:10,bridge_name='br-int',has_traffic_filtering=True,id=3258aab1-f0f0-4794-9ca4-1979321a98f0,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3258aab1-f0') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3258aab1-f0, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3258aab1-f0, col_values=(('external_ids', {'iface-id': '3258aab1-f0f0-4794-9ca4-1979321a98f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:16:10', 'vm-uuid': '07adce07-b416-44fb-b548-17b8cd0d8168'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:56 user nova-compute[70645]: INFO os_vif [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:16:10,bridge_name='br-int',has_traffic_filtering=True,id=3258aab1-f0f0-4794-9ca4-1979321a98f0,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3258aab1-f0')
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No VIF found with MAC fa:16:3e:9f:16:10, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.network.neutron [req-b743f79c-20bf-4384-be06-876b2e25e81d req-55830bf1-ed36-4b50-9d8e-46c791b151ac service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Updated VIF entry in instance network info cache for port 3258aab1-f0f0-4794-9ca4-1979321a98f0. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG nova.network.neutron [req-b743f79c-20bf-4384-be06-876b2e25e81d req-55830bf1-ed36-4b50-9d8e-46c791b151ac service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Updating instance_info_cache with network_info: [{"id": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "address": "fa:16:3e:9f:16:10", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3258aab1-f0", "ovs_interfaceid": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:00:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b743f79c-20bf-4384-be06-876b2e25e81d req-55830bf1-ed36-4b50-9d8e-46c791b151ac service nova] Releasing lock "refresh_cache-07adce07-b416-44fb-b548-17b8cd0d8168" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:00:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-3af31d02-3a5f-4834-9f04-97e66f4aa167 req-5dfd7735-2fa4-4a14-b7e3-f73d1faa9174 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Received event network-vif-plugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3af31d02-3a5f-4834-9f04-97e66f4aa167 req-5dfd7735-2fa4-4a14-b7e3-f73d1faa9174 service nova] Acquiring lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3af31d02-3a5f-4834-9f04-97e66f4aa167 req-5dfd7735-2fa4-4a14-b7e3-f73d1faa9174 service nova] Lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3af31d02-3a5f-4834-9f04-97e66f4aa167 req-5dfd7735-2fa4-4a14-b7e3-f73d1faa9174 service nova] Lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-3af31d02-3a5f-4834-9f04-97e66f4aa167 req-5dfd7735-2fa4-4a14-b7e3-f73d1faa9174 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] No waiting events found dispatching network-vif-plugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:57 user nova-compute[70645]: WARNING nova.compute.manager [req-3af31d02-3a5f-4834-9f04-97e66f4aa167 req-5dfd7735-2fa4-4a14-b7e3-f73d1faa9174 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Received unexpected event network-vif-plugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 for instance with vm_state building and task_state spawning.
Jul 24 15:00:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210859.5483243, 07adce07-b416-44fb-b548-17b8cd0d8168 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:00:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] VM Resumed (Lifecycle Event)
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:00:59 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Instance spawned successfully.
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:00:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210859.5498493, 07adce07-b416-44fb-b548-17b8cd0d8168 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:00:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] VM Started (Lifecycle Event)
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:00:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Took 5.44 seconds to spawn the instance on the hypervisor.
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:00:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-ae429e18-dd34-4937-ba3c-cd6b745d7b7d req-8863b85a-d958-4c9e-a728-c9771196a9cb service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Received event network-vif-plugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ae429e18-dd34-4937-ba3c-cd6b745d7b7d req-8863b85a-d958-4c9e-a728-c9771196a9cb service nova] Acquiring lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ae429e18-dd34-4937-ba3c-cd6b745d7b7d req-8863b85a-d958-4c9e-a728-c9771196a9cb service nova] Lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ae429e18-dd34-4937-ba3c-cd6b745d7b7d req-8863b85a-d958-4c9e-a728-c9771196a9cb service nova] Lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:00:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-ae429e18-dd34-4937-ba3c-cd6b745d7b7d req-8863b85a-d958-4c9e-a728-c9771196a9cb service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] No waiting events found dispatching network-vif-plugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:00:59 user nova-compute[70645]: WARNING nova.compute.manager [req-ae429e18-dd34-4937-ba3c-cd6b745d7b7d req-8863b85a-d958-4c9e-a728-c9771196a9cb service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Received unexpected event network-vif-plugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 for instance with vm_state building and task_state spawning.
Jul 24 15:00:59 user nova-compute[70645]: INFO nova.compute.manager [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Took 6.23 seconds to build instance.
Jul 24 15:00:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4b6593d1-250d-403a-9278-525ca453bfb2 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "07adce07-b416-44fb-b548-17b8cd0d8168" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.338s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'flavor' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:14 user nova-compute[70645]: INFO nova.compute.manager [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Attaching volume 4222d72b-3e4f-4712-87d6-dab4d4cbc758 to /dev/vdb
Jul 24 15:01:14 user nova-compute[70645]: DEBUG os_brick.utils [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d63062-d3a8-4f85-8902-bab6d13b91d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f64752-7f47-4849-858a-99f54a9a73ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[59644a79-607c-454c-ab62-8226d0d211f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[512fa212-08b1-4473-b1ad-6573adada3b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:01:14 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:01:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a538a3-5c45-48f0-a50a-3f48cf7ba393]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG os_brick.utils [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:01:14 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updating existing volume attachment record: 0baa1171-f6a3-40f6-8f83-200d3e47d493 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:01:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:01:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:01:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:01:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:22 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:01:22 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7452MB free_disk=25.40047836303711GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Applying migration context for instance 460ae655-2955-4a45-9b12-2a3ddd9f448b as it has an incoming, in-progress migration 2b4eadff-48a4-4aa1-8719-898abf635907. Migration status is finished {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 15:01:22 user nova-compute[70645]: INFO nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating resource usage from migration 2b4eadff-48a4-4aa1-8719-898abf635907
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 6fafa215-3ee5-4efb-816a-1d9f72e667da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 734abf9a-96dd-40b4-9b68-2d42fa079216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Migration 2b4eadff-48a4-4aa1-8719-898abf635907 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 460ae655-2955-4a45-9b12-2a3ddd9f448b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance c6738501-d019-48cb-b527-852fd6d61043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 07adce07-b416-44fb-b548-17b8cd0d8168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:01:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:01:23 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:01:23 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:01:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:01:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updating instance_info_cache with network_info: [{"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypdXhQnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:01:24 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:01:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:01:24 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:01:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:01:24 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0de616-7b9e-49ab-bfb0-f2c70cc9923b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:01:24 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cabf228-8194-482f-96b2-263c7529a44b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758] added
Jul 24 15:01:24 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8752508-88fc-4259-90d6-042ff15a4ad8]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[29841bee-4328-4b61-b216-bc1679278f4d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypdXhQnx {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypdXhQnx" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc649e1d-b6e3-4216-8939-8469dae6e33d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ypdXhQnx'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d90db4d-374c-4cd7-a4ec-855c28417541]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b5927-87ca-4b33-81d3-7b0c9acf451a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[516f7fce-0389-4432-9fe9-6a41c89d580b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758, portal: 172.16.0.220,3260]
Jul 24 15:01:25 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758, portal: 172.16.0.220,3260] successful.
Jul 24 15:01:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e963e45-9628-408c-bfd2-a31bfeea0660]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2b6fd3-f0d0-4dc1-9e05-8ed0c29decac]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:01:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cedd5e-88a9-40b9-9a6f-feadf12050fc]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:01:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypdXhQnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:01:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:01:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26338363965303539', 'path': '/dev/sde'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:01:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338363965303539', 'path': '/dev/sde'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:01:26 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'flavor' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:01:26 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:01:26 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:01:26 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:01:26 user nova-compute[70645]:   <serial>4222d72b-3e4f-4712-87d6-dab4d4cbc758</serial>
Jul 24 15:01:26 user nova-compute[70645]: </disk>
Jul 24 15:01:26 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:01:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:01:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:01:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] No VIF found with MAC fa:16:3e:5c:be:ca, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:01:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2353d3ff-ae72-4937-b687-3d37165737fa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.122s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:27 user nova-compute[70645]: INFO nova.compute.manager [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Rescuing
Jul 24 15:01:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:01:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquired lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:01:27 user nova-compute[70645]: DEBUG nova.network.neutron [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:01:28 user nova-compute[70645]: INFO nova.compute.claims [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Claim successful on node user
Jul 24 15:01:28 user nova-compute[70645]: DEBUG nova.network.neutron [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updating instance_info_cache with network_info: [{"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Releasing lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-3df0e134-3de8-4eff-92d1-0a509fc4cf58 req-400243ce-6e6a-46a2-b75c-8aa0c6c18983 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-unplugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3df0e134-3de8-4eff-92d1-0a509fc4cf58 req-400243ce-6e6a-46a2-b75c-8aa0c6c18983 service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3df0e134-3de8-4eff-92d1-0a509fc4cf58 req-400243ce-6e6a-46a2-b75c-8aa0c6c18983 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3df0e134-3de8-4eff-92d1-0a509fc4cf58 req-400243ce-6e6a-46a2-b75c-8aa0c6c18983 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-3df0e134-3de8-4eff-92d1-0a509fc4cf58 req-400243ce-6e6a-46a2-b75c-8aa0c6c18983 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-unplugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:01:28 user nova-compute[70645]: WARNING nova.compute.manager [req-3df0e134-3de8-4eff-92d1-0a509fc4cf58 req-400243ce-6e6a-46a2-b75c-8aa0c6c18983 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received unexpected event network-vif-unplugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with vm_state active and task_state rescuing.
Jul 24 15:01:28 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:01:28 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:01:29 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:01:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG nova.policy [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cfc37f67c214e638adb1409d4db18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2edf2107c94e1195d57905b59344fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:01:29 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Creating image(s)
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "/opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "/opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:29 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Instance destroyed successfully.
Jul 24 15:01:29 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Attempting a stable device rescue
Jul 24 15:01:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=70645) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk 1073741824" returned: 0 in 0.062s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Instance directory exists: not creating {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 15:01:29 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Creating image(s)
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "/opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "/opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG nova.objects.instance [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "6e17d52da7e570382a885e36b1815f94afdd1dec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6e17d52da7e570382a885e36b1815f94afdd1dec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:01:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec.part --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Successfully created port: 30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk --force-share --output=json" returned: 0 in 0.831s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Cannot resize image /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG nova.objects.instance [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'migration_context' on Instance uuid 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Ensure instance console log exists: /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec.part --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG nova.virt.images [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] 769db4e2-c360-4fa7-96a8-2542d87cf801 was qcow2, converting to raw {{(pid=70645) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec.part /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec.converted {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Port 3a56f8d6-1f50-46b0-949f-a64d933dd392 binding to destination host user is already ACTIVE {{(pid=70645) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquired lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec.part /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec.converted" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec.converted --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-38937633-27b2-4a08-8b19-08c53caac92a req-d9e8c8af-03c0-4635-a282-c4e7fbd4138b service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-38937633-27b2-4a08-8b19-08c53caac92a req-d9e8c8af-03c0-4635-a282-c4e7fbd4138b service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-38937633-27b2-4a08-8b19-08c53caac92a req-d9e8c8af-03c0-4635-a282-c4e7fbd4138b service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-38937633-27b2-4a08-8b19-08c53caac92a req-d9e8c8af-03c0-4635-a282-c4e7fbd4138b service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-38937633-27b2-4a08-8b19-08c53caac92a req-d9e8c8af-03c0-4635-a282-c4e7fbd4138b service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:01:30 user nova-compute[70645]: WARNING nova.compute.manager [req-38937633-27b2-4a08-8b19-08c53caac92a req-d9e8c8af-03c0-4635-a282-c4e7fbd4138b service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received unexpected event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with vm_state active and task_state rescuing.
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6e17d52da7e570382a885e36b1815f94afdd1dec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.330s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "6e17d52da7e570382a885e36b1815f94afdd1dec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6e17d52da7e570382a885e36b1815f94afdd1dec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec,backing_fmt=raw /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.rescue {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec,backing_fmt=raw /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.rescue" returned: 0 in 0.049s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6e17d52da7e570382a885e36b1815f94afdd1dec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'migration_context' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Start _get_guest_xml network_info=[{"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "vif_mac": "fa:16:3e:5c:be:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '769db4e2-c360-4fa7-96a8-2542d87cf801', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0baa1171-f6a3-40f6-8f83-200d3e47d493', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypdXhQnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '6fafa215-3ee5-4efb-816a-1d9f72e667da', 'attached_at': '', 'detached_at': '', 'volume_id': '4222d72b-3e4f-4712-87d6-dab4d4cbc758', 'serial': '4222d72b-3e4f-4712-87d6-dab4d4cbc758'}, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'resources' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'numa_topology' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:31 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:01:31 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypdXhQnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:01:31 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:01:31 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:01:31 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1824932-ef4b-48fc-99d8-63b8c80b7f5f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ypdXhQnx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 24 15:01:31 user nova-compute[70645]: node.name = iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758
Jul 24 15:01:31 user nova-compute[70645]: node.tpgt = -1
Jul 24 15:01:31 user nova-compute[70645]: node.startup = automatic
Jul 24 15:01:31 user nova-compute[70645]: node.leading_login = No
Jul 24 15:01:31 user nova-compute[70645]: iface.iscsi_ifacename = default
Jul 24 15:01:31 user nova-compute[70645]: iface.net_ifacename = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.ipaddress = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.prefix_len = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.hwaddress = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.transport_name = tcp
Jul 24 15:01:31 user nova-compute[70645]: iface.initiatorname = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.state = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.vlan_id = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.vlan_priority = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.vlan_state = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.iface_num = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.mtu = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.port = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.bootproto = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.subnet_mask = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.gateway = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.dhcp_alt_client_id_state = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.dhcp_alt_client_id = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.dhcp_dns = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.dhcp_learn_iqn = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.dhcp_req_vendor_id_state = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.dhcp_vendor_id_state = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.dhcp_vendor_id = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.dhcp_slp_da = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.fragmentation = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.gratuitous_arp = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.incoming_forwarding = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.tos_state = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.tos = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.ttl = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.delayed_ack = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.tcp_nagle = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.tcp_wsf_state = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.tcp_wsf = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.tcp_timer_scale = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.tcp_timestamp = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.redirect = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.def_task_mgmt_timeout = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.header_digest = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.data_digest = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.immediate_data = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.initial_r2t = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.data_seq_inorder = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.data_pdu_inorder = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.erl = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.max_receive_data_len = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.first_burst_len = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.max_outstanding_r2t = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.max_burst_len = 0
Jul 24 15:01:31 user nova-compute[70645]: iface.chap_auth = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.bidi_chap = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.strict_login_compliance = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.discovery_auth = <empty>
Jul 24 15:01:31 user nova-compute[70645]: iface.discovery_logout = <empty>
Jul 24 15:01:31 user nova-compute[70645]: node.discovery_address = <empty>
Jul 24 15:01:31 user nova-compute[70645]: node.discovery_port = 0
Jul 24 15:01:31 user nova-compute[70645]: node.discovery_type = static
Jul 24 15:01:31 user nova-compute[70645]: node.session.initial_cmdsn = 0
Jul 24 15:01:31 user nova-compute[70645]: node.session.initial_login_retry_max = 8
Jul 24 15:01:31 user nova-compute[70645]: node.session.xmit_thread_priority = -20
Jul 24 15:01:31 user nova-compute[70645]: node.session.cmds_max = 128
Jul 24 15:01:31 user nova-compute[70645]: node.session.queue_depth = 32
Jul 24 15:01:31 user nova-compute[70645]: node.session.nr_sessions = 1
Jul 24 15:01:31 user nova-compute[70645]: node.session.auth.authmethod = CHAP
Jul 24 15:01:31 user nova-compute[70645]: node.session.auth.username = ypdXhQnx
Jul 24 15:01:31 user nova-compute[70645]: node.session.auth.password = ***
Jul 24 15:01:31 user nova-compute[70645]: node.session.auth.username_in = <empty>
Jul 24 15:01:31 user nova-compute[70645]: node.session.auth.password_in = <empty>
Jul 24 15:01:31 user nova-compute[70645]: node.session.auth.chap_algs = MD5
Jul 24 15:01:31 user nova-compute[70645]: node.session.timeo.replacement_timeout = 120
Jul 24 15:01:31 user nova-compute[70645]: node.session.err_timeo.abort_timeout = 15
Jul 24 15:01:31 user nova-compute[70645]: node.session.err_timeo.lu_reset_timeout = 30
Jul 24 15:01:31 user nova-compute[70645]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 24 15:01:31 user nova-compute[70645]: node.session.err_timeo.host_reset_timeout = 60
Jul 24 15:01:31 user nova-compute[70645]: node.session.iscsi.FastAbort = Yes
Jul 24 15:01:31 user nova-compute[70645]: node.session.iscsi.InitialR2T = No
Jul 24 15:01:31 user nova-compute[70645]: node.session.iscsi.ImmediateData = Yes
Jul 24 15:01:31 user nova-compute[70645]: node.session.iscsi.FirstBurstLength = 262144
Jul 24 15:01:31 user nova-compute[70645]: node.session.iscsi.MaxBurstLength = 16776192
Jul 24 15:01:31 user nova-compute[70645]: node.session.iscsi.DefaultTime2Retain = 0
Jul 24 15:01:31 user nova-compute[70645]: node.session.iscsi.DefaultTime2Wait = 2
Jul 24 15:01:31 user nova-compute[70645]: node.session.iscsi.MaxConnections = 1
Jul 24 15:01:31 user nova-compute[70645]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 24 15:01:31 user nova-compute[70645]: node.session.iscsi.ERL = 0
Jul 24 15:01:31 user nova-compute[70645]: node.session.scan = manual
Jul 24 15:01:31 user nova-compute[70645]: node.session.reopen_max = 0
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].address = 172.16.0.220
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].port = 3260
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].startup = manual
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].tcp.window_size = 524288
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].tcp.type_of_service = 0
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].timeo.logout_timeout = 15
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].timeo.login_timeout = 15
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].timeo.auth_timeout = 45
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].timeo.noop_out_interval = 5
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].timeo.noop_out_timeout = 5
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].iscsi.HeaderDigest = None
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].iscsi.DataDigest = None
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].iscsi.IFMarker = No
Jul 24 15:01:31 user nova-compute[70645]: node.conn[0].iscsi.OFMarker = No
Jul 24 15:01:31 user nova-compute[70645]: # END RECORD
Jul 24 15:01:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating instance_info_cache with network_info: [{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c41e5f8-c5b6-483f-a9fc-c7ae73922c75]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Releasing lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93cbe5c-0e4d-4249-aa5b-3fba5f71300e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypdXhQnx {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Creating tmpfile /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/tmp7vxj1d8g to verify with other compute node that the instance is on the same shared storage. {{(pid=70645) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypdXhQnx" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ddadba-e173-4bcb-b09b-73dd0c34f706]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ypdXhQnx'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f827724-c9a9-4281-9859-cdffdc73b872]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf9cacd-5541-40c7-9f10-ad3f7cb916be]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:31 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:01:31 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:31 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:31 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:01:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:31 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:01:31 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:31 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:31 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:01:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.155s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] HCTL ('36', '0', '0', 0) found on session 25 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e20b6a2-dd24-4636-bb29-c7e95ad8f10b]: (4, ('0 0 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Searching for a device in session 25 and hctl ('36', '0', '0', 0) yield: sde {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypdXhQnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] <== connect_volume: return (180ms) {'type': 'block', 'scsi_wwn': '26338363965303539', 'path': '/dev/sde'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338363965303539', 'path': '/dev/sde'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1233785489',display_name='tempest-ServerStableDeviceRescueTest-server-1233785489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1233785489',id=17,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXs5WJpPEztU3bfcQKgE/HpXK8WmqpvoWAYUQl0M18pIkCkgsIYQ1MmCYCpsMYDnyC9pUZ7q7T6GsoqZ5+Vq8EmW7X8NdZgpv4sxbNieOyY+y5vMm+LYNVL7UXtGRhQFA==',key_name='tempest-keypair-115789889',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54c90b1c32384354a8ba5140a846be6f',ramdisk_id='',reservation_id='r-1w9tjbeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-494685022',owner_user_name='tempest-ServerStableDeviceRescueTest-494685022-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1adea3e2d58a473b9f7f40a21f7c7bea',uuid=6fafa215-3ee5-4efb-816a-1d9f72e667da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "vif_mac": "fa:16:3e:5c:be:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Converting VIF {"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "vif_mac": "fa:16:3e:5c:be:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:be:ca,bridge_name='br-int',has_traffic_filtering=True,id=02ca6838-89e2-41bc-a858-dc7a007f7960,network=Network(c2cb753b-9202-48c0-923f-2a9713209b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ca6838-89') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:01:31 user nova-compute[70645]:   <uuid>6fafa215-3ee5-4efb-816a-1d9f72e667da</uuid>
Jul 24 15:01:31 user nova-compute[70645]:   <name>instance-00000011</name>
Jul 24 15:01:31 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:01:31 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:01:31 user nova-compute[70645]:   <metadata>
Jul 24 15:01:31 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:01:31 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:01:31 user nova-compute[70645]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1233785489</nova:name>
Jul 24 15:01:31 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:01:31</nova:creationTime>
Jul 24 15:01:31 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:01:31 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:01:31 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:01:31 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:01:31 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:01:31 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:01:31 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:01:31 user nova-compute[70645]:       <nova:owner>
Jul 24 15:01:31 user nova-compute[70645]:         <nova:user uuid="1adea3e2d58a473b9f7f40a21f7c7bea">tempest-ServerStableDeviceRescueTest-494685022-project-member</nova:user>
Jul 24 15:01:31 user nova-compute[70645]:         <nova:project uuid="54c90b1c32384354a8ba5140a846be6f">tempest-ServerStableDeviceRescueTest-494685022</nova:project>
Jul 24 15:01:31 user nova-compute[70645]:       </nova:owner>
Jul 24 15:01:31 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:01:31 user nova-compute[70645]:       <nova:ports>
Jul 24 15:01:31 user nova-compute[70645]:         <nova:port uuid="02ca6838-89e2-41bc-a858-dc7a007f7960">
Jul 24 15:01:31 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 15:01:31 user nova-compute[70645]:         </nova:port>
Jul 24 15:01:31 user nova-compute[70645]:       </nova:ports>
Jul 24 15:01:31 user nova-compute[70645]:     </nova:instance>
Jul 24 15:01:31 user nova-compute[70645]:   </metadata>
Jul 24 15:01:31 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:01:31 user nova-compute[70645]:     <system>
Jul 24 15:01:31 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:01:31 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:01:31 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:01:31 user nova-compute[70645]:       <entry name="serial">6fafa215-3ee5-4efb-816a-1d9f72e667da</entry>
Jul 24 15:01:31 user nova-compute[70645]:       <entry name="uuid">6fafa215-3ee5-4efb-816a-1d9f72e667da</entry>
Jul 24 15:01:31 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:01:31 user nova-compute[70645]:     </system>
Jul 24 15:01:31 user nova-compute[70645]:   </sysinfo>
Jul 24 15:01:31 user nova-compute[70645]:   <os>
Jul 24 15:01:31 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:01:31 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:01:31 user nova-compute[70645]:   </os>
Jul 24 15:01:31 user nova-compute[70645]:   <features>
Jul 24 15:01:31 user nova-compute[70645]:     <acpi/>
Jul 24 15:01:31 user nova-compute[70645]:     <apic/>
Jul 24 15:01:31 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:01:31 user nova-compute[70645]:   </features>
Jul 24 15:01:31 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:01:31 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:01:31 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:01:31 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:01:31 user nova-compute[70645]:   </clock>
Jul 24 15:01:31 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:01:31 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:01:31 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:01:31 user nova-compute[70645]:   </cpu>
Jul 24 15:01:31 user nova-compute[70645]:   <devices>
Jul 24 15:01:31 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:01:31 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:01:31 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk"/>
Jul 24 15:01:31 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:01:31 user nova-compute[70645]:     </disk>
Jul 24 15:01:31 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:01:31 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:01:31 user nova-compute[70645]:       <source dev="/dev/sde"/>
Jul 24 15:01:31 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 15:01:31 user nova-compute[70645]:       <serial>4222d72b-3e4f-4712-87d6-dab4d4cbc758</serial>
Jul 24 15:01:31 user nova-compute[70645]:     </disk>
Jul 24 15:01:31 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:01:31 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:01:31 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.rescue"/>
Jul 24 15:01:31 user nova-compute[70645]:       <target dev="vdc" bus="virtio"/>
Jul 24 15:01:31 user nova-compute[70645]:       <boot order="1"/>
Jul 24 15:01:31 user nova-compute[70645]:     </disk>
Jul 24 15:01:31 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:01:31 user nova-compute[70645]:       <mac address="fa:16:3e:5c:be:ca"/>
Jul 24 15:01:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:01:31 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:01:31 user nova-compute[70645]:       <target dev="tap02ca6838-89"/>
Jul 24 15:01:31 user nova-compute[70645]:     </interface>
Jul 24 15:01:31 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:01:31 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/console.log" append="off"/>
Jul 24 15:01:31 user nova-compute[70645]:     </serial>
Jul 24 15:01:31 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:01:31 user nova-compute[70645]:     <video>
Jul 24 15:01:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:01:31 user nova-compute[70645]:     </video>
Jul 24 15:01:31 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:01:31 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:01:31 user nova-compute[70645]:     </rng>
Jul 24 15:01:31 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:01:31 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:01:31 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:01:31 user nova-compute[70645]:     </memballoon>
Jul 24 15:01:31 user nova-compute[70645]:   </devices>
Jul 24 15:01:31 user nova-compute[70645]: </domain>
Jul 24 15:01:31 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:31 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Instance destroyed successfully.
Jul 24 15:01:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] No VIF found with MAC fa:16:3e:5c:be:ca, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-09108171-f681-43b7-ac89-083275439545 req-1fe0a270-984f-4a8f-b5c3-89833f72ec16 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-unplugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-09108171-f681-43b7-ac89-083275439545 req-1fe0a270-984f-4a8f-b5c3-89833f72ec16 service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-09108171-f681-43b7-ac89-083275439545 req-1fe0a270-984f-4a8f-b5c3-89833f72ec16 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-09108171-f681-43b7-ac89-083275439545 req-1fe0a270-984f-4a8f-b5c3-89833f72ec16 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-09108171-f681-43b7-ac89-083275439545 req-1fe0a270-984f-4a8f-b5c3-89833f72ec16 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-unplugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:01:31 user nova-compute[70645]: WARNING nova.compute.manager [req-09108171-f681-43b7-ac89-083275439545 req-1fe0a270-984f-4a8f-b5c3-89833f72ec16 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received unexpected event network-vif-unplugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with vm_state resized and task_state resize_reverting.
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Successfully updated port: 30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "refresh_cache-5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquired lock "refresh_cache-5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:01:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Updating instance_info_cache with network_info: [{"id": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "address": "fa:16:3e:f1:41:1a", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30e4879f-dc", "ovs_interfaceid": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Releasing lock "refresh_cache-5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Instance network_info: |[{"id": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "address": "fa:16:3e:f1:41:1a", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30e4879f-dc", "ovs_interfaceid": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Start _get_guest_xml network_info=[{"id": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "address": "fa:16:3e:f1:41:1a", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30e4879f-dc", "ovs_interfaceid": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:01:32 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:01:32 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-13420737',display_name='tempest-VolumesSnapshotTestJSON-instance-13420737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-13420737',id=25,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADUTyqkK4wtlzDXr2TnBZaDT1YCMHmG8Cd5k6DeSDD74pppraUSyNbHW3G1corvEzB2MLRhpynn9fEA+OgwcNG4UcDU1Y1iEYTiMNEgzViS6EMuePJewnweJlzQKFOMoQ==',key_name='tempest-keypair-1084911921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2edf2107c94e1195d57905b59344fb',ramdisk_id='',reservation_id='r-xnv4ezsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1862271743',owner_user_name='tempest-VolumesSnapshotTestJSON-1862271743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cfc37f67c214e638adb1409d4db18d6',uuid=5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "address": "fa:16:3e:f1:41:1a", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30e4879f-dc", "ovs_interfaceid": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converting VIF {"id": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "address": "fa:16:3e:f1:41:1a", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30e4879f-dc", "ovs_interfaceid": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:41:1a,bridge_name='br-int',has_traffic_filtering=True,id=30e4879f-dced-4de7-92f5-251b88dc5a8c,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30e4879f-dc') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:01:32 user nova-compute[70645]:   <uuid>5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9</uuid>
Jul 24 15:01:32 user nova-compute[70645]:   <name>instance-00000019</name>
Jul 24 15:01:32 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:01:32 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:01:32 user nova-compute[70645]:   <metadata>
Jul 24 15:01:32 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:01:32 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:01:32 user nova-compute[70645]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-13420737</nova:name>
Jul 24 15:01:32 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:01:32</nova:creationTime>
Jul 24 15:01:32 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:01:32 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:01:32 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:01:32 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:01:32 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:01:32 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:01:32 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:01:32 user nova-compute[70645]:       <nova:owner>
Jul 24 15:01:32 user nova-compute[70645]:         <nova:user uuid="4cfc37f67c214e638adb1409d4db18d6">tempest-VolumesSnapshotTestJSON-1862271743-project-member</nova:user>
Jul 24 15:01:32 user nova-compute[70645]:         <nova:project uuid="5f2edf2107c94e1195d57905b59344fb">tempest-VolumesSnapshotTestJSON-1862271743</nova:project>
Jul 24 15:01:32 user nova-compute[70645]:       </nova:owner>
Jul 24 15:01:32 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:01:32 user nova-compute[70645]:       <nova:ports>
Jul 24 15:01:32 user nova-compute[70645]:         <nova:port uuid="30e4879f-dced-4de7-92f5-251b88dc5a8c">
Jul 24 15:01:32 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 15:01:32 user nova-compute[70645]:         </nova:port>
Jul 24 15:01:32 user nova-compute[70645]:       </nova:ports>
Jul 24 15:01:32 user nova-compute[70645]:     </nova:instance>
Jul 24 15:01:32 user nova-compute[70645]:   </metadata>
Jul 24 15:01:32 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:01:32 user nova-compute[70645]:     <system>
Jul 24 15:01:32 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:01:32 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:01:32 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:01:32 user nova-compute[70645]:       <entry name="serial">5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9</entry>
Jul 24 15:01:32 user nova-compute[70645]:       <entry name="uuid">5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9</entry>
Jul 24 15:01:32 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:01:32 user nova-compute[70645]:     </system>
Jul 24 15:01:32 user nova-compute[70645]:   </sysinfo>
Jul 24 15:01:32 user nova-compute[70645]:   <os>
Jul 24 15:01:32 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:01:32 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:01:32 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:01:32 user nova-compute[70645]:   </os>
Jul 24 15:01:32 user nova-compute[70645]:   <features>
Jul 24 15:01:32 user nova-compute[70645]:     <acpi/>
Jul 24 15:01:32 user nova-compute[70645]:     <apic/>
Jul 24 15:01:32 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:01:32 user nova-compute[70645]:   </features>
Jul 24 15:01:32 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:01:32 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:01:32 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:01:32 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:01:32 user nova-compute[70645]:   </clock>
Jul 24 15:01:32 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:01:32 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:01:32 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:01:32 user nova-compute[70645]:   </cpu>
Jul 24 15:01:32 user nova-compute[70645]:   <devices>
Jul 24 15:01:32 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:01:32 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:01:32 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk"/>
Jul 24 15:01:32 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:01:32 user nova-compute[70645]:     </disk>
Jul 24 15:01:32 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:01:32 user nova-compute[70645]:       <mac address="fa:16:3e:f1:41:1a"/>
Jul 24 15:01:32 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:01:32 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:01:32 user nova-compute[70645]:       <target dev="tap30e4879f-dc"/>
Jul 24 15:01:32 user nova-compute[70645]:     </interface>
Jul 24 15:01:32 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:01:32 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/console.log" append="off"/>
Jul 24 15:01:32 user nova-compute[70645]:     </serial>
Jul 24 15:01:32 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:01:32 user nova-compute[70645]:     <video>
Jul 24 15:01:32 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:01:32 user nova-compute[70645]:     </video>
Jul 24 15:01:32 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:01:32 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:01:32 user nova-compute[70645]:     </rng>
Jul 24 15:01:32 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:01:32 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:01:32 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:01:32 user nova-compute[70645]:     </memballoon>
Jul 24 15:01:32 user nova-compute[70645]:   </devices>
Jul 24 15:01:32 user nova-compute[70645]: </domain>
Jul 24 15:01:32 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-13420737',display_name='tempest-VolumesSnapshotTestJSON-instance-13420737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-13420737',id=25,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADUTyqkK4wtlzDXr2TnBZaDT1YCMHmG8Cd5k6DeSDD74pppraUSyNbHW3G1corvEzB2MLRhpynn9fEA+OgwcNG4UcDU1Y1iEYTiMNEgzViS6EMuePJewnweJlzQKFOMoQ==',key_name='tempest-keypair-1084911921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2edf2107c94e1195d57905b59344fb',ramdisk_id='',reservation_id='r-xnv4ezsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1862271743',owner_user_name='tempest-VolumesSnapshotTestJSON-1862271743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cfc37f67c214e638adb1409d4db18d6',uuid=5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "address": "fa:16:3e:f1:41:1a", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30e4879f-dc", "ovs_interfaceid": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converting VIF {"id": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "address": "fa:16:3e:f1:41:1a", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30e4879f-dc", "ovs_interfaceid": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:41:1a,bridge_name='br-int',has_traffic_filtering=True,id=30e4879f-dced-4de7-92f5-251b88dc5a8c,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30e4879f-dc') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_vif [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:41:1a,bridge_name='br-int',has_traffic_filtering=True,id=30e4879f-dced-4de7-92f5-251b88dc5a8c,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30e4879f-dc') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30e4879f-dc, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30e4879f-dc, col_values=(('external_ids', {'iface-id': '30e4879f-dced-4de7-92f5-251b88dc5a8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:41:1a', 'vm-uuid': '5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:32 user nova-compute[70645]: INFO os_vif [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:41:1a,bridge_name='br-int',has_traffic_filtering=True,id=30e4879f-dced-4de7-92f5-251b88dc5a8c,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30e4879f-dc')
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] No VIF found with MAC fa:16:3e:f1:41:1a, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance destroyed successfully.
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'resources' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887972996',display_name='tempest-ServerActionsTestOtherB-server-1887972996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887972996',id=14,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMleqYhBZCEEjJJsaMEuckPLdRSggssXX58+jSUDWV4RWgJi1aCvZ7GKXmFcDgd20RUebLSGWW0+tvwfBRktv2c+QmVz9Ve3ikoCtp5+5Q7Q8T6xY4TIWukXrdzPtz1wFA==',key_name='tempest-keypair-1765023642',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:59:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a7fb98af2b84c51a448d39d957f5f6a',ramdisk_id='',reservation_id='r-fex15wu9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-589948319',owner_user_name='tempest-ServerActionsTestOtherB-589948319-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01c8ead2665a44c8a24dd89ee3b18a72',uuid=460ae655-2955-4a45-9b12-2a3ddd9f448b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converting VIF {"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_vif [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a56f8d6-1f, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:32 user nova-compute[70645]: INFO os_vif [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f')
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYVBiqzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:01:32 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ee1c33-4183-4804-a021-9aa484ba8a4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[269a5635-c88a-4a52-90b5-6cb24131ec94]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:32 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:01:32 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:32 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:32 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:01:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:32 user nova-compute[70645]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:01:32 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:32 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:32 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:01:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba9421dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a065a6-08e3-4d37-ad42-cda75a36d6ef]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d84386-5145-4720-8f5a-d47390aa6fd7]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6224bf-772f-4835-89a7-d0d3aee816c0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5c964-20fb-40df-b781-9b15e567ca26]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b02ea45-8817-439a-b686-03a173406d01]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef00c3c4-e51e-41ea-b2fa-187981bc1c97]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]
Jul 24 15:01:32 user nova-compute[70645]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.
Jul 24 15:01:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9353341-e47f-422d-b4de-23e3a334be70]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] <== disconnect_volume: return (279ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-2b39c719-2973-49a2-9028-3ab95badd0aa req-fbaf07fd-dbe4-40e8-9a1f-c4b9cb7d6e26 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Received event network-changed-30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-2b39c719-2973-49a2-9028-3ab95badd0aa req-fbaf07fd-dbe4-40e8-9a1f-c4b9cb7d6e26 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Refreshing instance network info cache due to event network-changed-30e4879f-dced-4de7-92f5-251b88dc5a8c. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2b39c719-2973-49a2-9028-3ab95badd0aa req-fbaf07fd-dbe4-40e8-9a1f-c4b9cb7d6e26 service nova] Acquiring lock "refresh_cache-5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2b39c719-2973-49a2-9028-3ab95badd0aa req-fbaf07fd-dbe4-40e8-9a1f-c4b9cb7d6e26 service nova] Acquired lock "refresh_cache-5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:01:32 user nova-compute[70645]: DEBUG nova.network.neutron [req-2b39c719-2973-49a2-9028-3ab95badd0aa req-fbaf07fd-dbe4-40e8-9a1f-c4b9cb7d6e26 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Refreshing network info cache for port 30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:01:33 user nova-compute[70645]: DEBUG nova.network.neutron [req-2b39c719-2973-49a2-9028-3ab95badd0aa req-fbaf07fd-dbe4-40e8-9a1f-c4b9cb7d6e26 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Updated VIF entry in instance network info cache for port 30e4879f-dced-4de7-92f5-251b88dc5a8c. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:01:33 user nova-compute[70645]: DEBUG nova.network.neutron [req-2b39c719-2973-49a2-9028-3ab95badd0aa req-fbaf07fd-dbe4-40e8-9a1f-c4b9cb7d6e26 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Updating instance_info_cache with network_info: [{"id": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "address": "fa:16:3e:f1:41:1a", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30e4879f-dc", "ovs_interfaceid": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:01:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2b39c719-2973-49a2-9028-3ab95badd0aa req-fbaf07fd-dbe4-40e8-9a1f-c4b9cb7d6e26 service nova] Releasing lock "refresh_cache-5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:01:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-629d738a-1692-4ae5-869e-0f78ab239473 req-587c855d-841d-4ca9-8351-6234ef96896f service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:01:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-629d738a-1692-4ae5-869e-0f78ab239473 req-587c855d-841d-4ca9-8351-6234ef96896f service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-629d738a-1692-4ae5-869e-0f78ab239473 req-587c855d-841d-4ca9-8351-6234ef96896f service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-629d738a-1692-4ae5-869e-0f78ab239473 req-587c855d-841d-4ca9-8351-6234ef96896f service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-629d738a-1692-4ae5-869e-0f78ab239473 req-587c855d-841d-4ca9-8351-6234ef96896f service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:01:33 user nova-compute[70645]: WARNING nova.compute.manager [req-629d738a-1692-4ae5-869e-0f78ab239473 req-587c855d-841d-4ca9-8351-6234ef96896f service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received unexpected event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with vm_state resized and task_state resize_reverting.
Jul 24 15:01:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:33 user nova-compute[70645]: DEBUG nova.objects.instance [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'migration_context' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.456s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:34 user nova-compute[70645]: INFO nova.compute.manager [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Swapping old allocation on dict_keys(['a0cf5b80-69d2-4191-894e-a498eab7d688']) held by migration 2b4eadff-48a4-4aa1-8719-898abf635907 for instance
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Overwriting current allocation {'allocations': {'a0cf5b80-69d2-4191-894e-a498eab7d688': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 29}}, 'project_id': '6a7fb98af2b84c51a448d39d957f5f6a', 'user_id': '01c8ead2665a44c8a24dd89ee3b18a72', 'consumer_generation': 1} on consumer 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquired lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG nova.network.neutron [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:01:34 user nova-compute[70645]: WARNING nova.compute.manager [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received unexpected event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with vm_state active and task_state rescuing.
Jul 24 15:01:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:01:35 user nova-compute[70645]: WARNING nova.compute.manager [req-34ab6add-2e6d-47a4-8d8e-532213dc58e1 req-6b851234-299a-4bfa-91fe-a0d679162b58 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received unexpected event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with vm_state active and task_state rescuing.
Jul 24 15:01:35 user nova-compute[70645]: DEBUG nova.network.neutron [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating instance_info_cache with network_info: [{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Releasing lock "refresh_cache-460ae655-2955-4a45-9b12-2a3ddd9f448b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG os_brick.utils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[da723fa7-8554-4a0d-a42e-67e21951593d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef0d10-f6d2-40ee-a7d6-995e352c9d20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d763a2c5-a62a-4f49-9153-660e0148f5a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec005b2-bea7-40ca-a3c8-808730c2bc0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:01:35 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcbceb3-b02e-4600-9ed1-fa7075eb0599]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG os_brick.utils [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Received event network-vif-plugged-30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] Acquiring lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] No waiting events found dispatching network-vif-plugged-30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:01:35 user nova-compute[70645]: WARNING nova.compute.manager [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Received unexpected event network-vif-plugged-30e4879f-dced-4de7-92f5-251b88dc5a8c for instance with vm_state building and task_state spawning.
Jul 24 15:01:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Received event network-vif-plugged-30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] Acquiring lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] No waiting events found dispatching network-vif-plugged-30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:01:35 user nova-compute[70645]: WARNING nova.compute.manager [req-a4b59246-8e49-4611-a2bd-fa6ac3e69135 req-9d4dbdd5-58b9-4958-b4ee-1bf8e3dbe301 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Received unexpected event network-vif-plugged-30e4879f-dced-4de7-92f5-251b88dc5a8c for instance with vm_state building and task_state spawning.
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210896.832295, 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:01:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] VM Resumed (Lifecycle Event)
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-297dbf46-3e72-43de-93f9-9c315e3084f4 tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:01:36 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Instance spawned successfully.
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:01:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210896.835287, 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:01:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] VM Started (Lifecycle Event)
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:01:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 6fafa215-3ee5-4efb-816a-1d9f72e667da due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210896.8396456, 6fafa215-3ee5-4efb-816a-1d9f72e667da => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:01:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] VM Resumed (Lifecycle Event)
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:01:36 user nova-compute[70645]: INFO nova.compute.manager [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Took 7.84 seconds to spawn the instance on the hypervisor.
Jul 24 15:01:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:01:37 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210896.8399627, 6fafa215-3ee5-4efb-816a-1d9f72e667da => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:01:37 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] VM Started (Lifecycle Event)
Jul 24 15:01:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:01:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:01:37 user nova-compute[70645]: INFO nova.compute.manager [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Took 8.68 seconds to build instance.
Jul 24 15:01:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d907ae0-1f56-45ee-9520-a0fa5275a1aa tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.775s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Starting finish_revert_migration {{(pid=70645) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Start _get_guest_xml network_info=[{"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e1c6d0bc-4ef0-4286-a9b2-7a94e70dbcc4', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYVBiqzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '460ae655-2955-4a45-9b12-2a3ddd9f448b', 'attached_at': '2023-07-24T15:01:42.000000', 'detached_at': '', 'volume_id': '9814e40c-d816-44f0-9243-eb5d61f88153', 'serial': '9814e40c-d816-44f0-9243-eb5d61f88153'}, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:01:42 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:01:42 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.objects.instance [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'vcpu_model' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYVBiqzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:01:42 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:01:42 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:01:42 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feaabdb-1cff-4a38-838f-40044e572f5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:01:42 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[453902ca-579d-4e91-9298-fdb3aac61ff9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153] added
Jul 24 15:01:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9e5ff5-d958-4b44-96b9-20e69872b0dc]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43293d3-3744-42ff-a419-6b041a8a61cd]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYVBiqzZ {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYVBiqzZ" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a6a8c9-950f-430b-9764-eb052ea2c1b3]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYVBiqzZ'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7eaa603-d8eb-4bd4-9ef0-7ce6b3b2f5b5]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3916ac-2352-447f-8a5b-896aee7dd3bb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ec8dd3-5fe8-4b13-b202-c577cd7d2e5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]
Jul 24 15:01:42 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.
Jul 24 15:01:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c45886f-367b-4689-8d34-499e304b8d86]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c2cc22-54b5-4160-9b29-7a7877b5c0ce]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:01:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de3fe94-9d58-44c0-816b-8a6b84970712]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:01:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYVBiqzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23364316336366339', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364316336366339', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887972996',display_name='tempest-ServerActionsTestOtherB-server-1887972996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887972996',id=14,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMleqYhBZCEEjJJsaMEuckPLdRSggssXX58+jSUDWV4RWgJi1aCvZ7GKXmFcDgd20RUebLSGWW0+tvwfBRktv2c+QmVz9Ve3ikoCtp5+5Q7Q8T6xY4TIWukXrdzPtz1wFA==',key_name='tempest-keypair-1765023642',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:59:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a7fb98af2b84c51a448d39d957f5f6a',ramdisk_id='',reservation_id='r-fex15wu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-589948319',owner_user_name='tempest-ServerActionsTestOtherB-589948319-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01c8ead2665a44c8a24dd89ee3b18a72',uuid=460ae655-2955-4a45-9b12-2a3ddd9f448b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converting VIF {"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:01:43 user nova-compute[70645]:   <uuid>460ae655-2955-4a45-9b12-2a3ddd9f448b</uuid>
Jul 24 15:01:43 user nova-compute[70645]:   <name>instance-0000000e</name>
Jul 24 15:01:43 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:01:43 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:01:43 user nova-compute[70645]:   <metadata>
Jul 24 15:01:43 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:01:43 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:01:43 user nova-compute[70645]:       <nova:name>tempest-ServerActionsTestOtherB-server-1887972996</nova:name>
Jul 24 15:01:43 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:01:42</nova:creationTime>
Jul 24 15:01:43 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:01:43 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:01:43 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:01:43 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:01:43 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:01:43 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:01:43 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:01:43 user nova-compute[70645]:       <nova:owner>
Jul 24 15:01:43 user nova-compute[70645]:         <nova:user uuid="01c8ead2665a44c8a24dd89ee3b18a72">tempest-ServerActionsTestOtherB-589948319-project-member</nova:user>
Jul 24 15:01:43 user nova-compute[70645]:         <nova:project uuid="6a7fb98af2b84c51a448d39d957f5f6a">tempest-ServerActionsTestOtherB-589948319</nova:project>
Jul 24 15:01:43 user nova-compute[70645]:       </nova:owner>
Jul 24 15:01:43 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:01:43 user nova-compute[70645]:       <nova:ports>
Jul 24 15:01:43 user nova-compute[70645]:         <nova:port uuid="3a56f8d6-1f50-46b0-949f-a64d933dd392">
Jul 24 15:01:43 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 15:01:43 user nova-compute[70645]:         </nova:port>
Jul 24 15:01:43 user nova-compute[70645]:       </nova:ports>
Jul 24 15:01:43 user nova-compute[70645]:     </nova:instance>
Jul 24 15:01:43 user nova-compute[70645]:   </metadata>
Jul 24 15:01:43 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:01:43 user nova-compute[70645]:     <system>
Jul 24 15:01:43 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:01:43 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:01:43 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:01:43 user nova-compute[70645]:       <entry name="serial">460ae655-2955-4a45-9b12-2a3ddd9f448b</entry>
Jul 24 15:01:43 user nova-compute[70645]:       <entry name="uuid">460ae655-2955-4a45-9b12-2a3ddd9f448b</entry>
Jul 24 15:01:43 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:01:43 user nova-compute[70645]:     </system>
Jul 24 15:01:43 user nova-compute[70645]:   </sysinfo>
Jul 24 15:01:43 user nova-compute[70645]:   <os>
Jul 24 15:01:43 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:01:43 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:01:43 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:01:43 user nova-compute[70645]:   </os>
Jul 24 15:01:43 user nova-compute[70645]:   <features>
Jul 24 15:01:43 user nova-compute[70645]:     <acpi/>
Jul 24 15:01:43 user nova-compute[70645]:     <apic/>
Jul 24 15:01:43 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:01:43 user nova-compute[70645]:   </features>
Jul 24 15:01:43 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:01:43 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:01:43 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:01:43 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:01:43 user nova-compute[70645]:   </clock>
Jul 24 15:01:43 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:01:43 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:01:43 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:01:43 user nova-compute[70645]:   </cpu>
Jul 24 15:01:43 user nova-compute[70645]:   <devices>
Jul 24 15:01:43 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:01:43 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:01:43 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk"/>
Jul 24 15:01:43 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:01:43 user nova-compute[70645]:     </disk>
Jul 24 15:01:43 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:01:43 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:01:43 user nova-compute[70645]:       <source dev="/dev/sdb"/>
Jul 24 15:01:43 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 15:01:43 user nova-compute[70645]:       <serial>9814e40c-d816-44f0-9243-eb5d61f88153</serial>
Jul 24 15:01:43 user nova-compute[70645]:     </disk>
Jul 24 15:01:43 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:01:43 user nova-compute[70645]:       <mac address="fa:16:3e:46:ef:9d"/>
Jul 24 15:01:43 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:01:43 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:01:43 user nova-compute[70645]:       <target dev="tap3a56f8d6-1f"/>
Jul 24 15:01:43 user nova-compute[70645]:     </interface>
Jul 24 15:01:43 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:01:43 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/console.log" append="off"/>
Jul 24 15:01:43 user nova-compute[70645]:     </serial>
Jul 24 15:01:43 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:01:43 user nova-compute[70645]:     <video>
Jul 24 15:01:43 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:01:43 user nova-compute[70645]:     </video>
Jul 24 15:01:43 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:01:43 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:01:43 user nova-compute[70645]:     </rng>
Jul 24 15:01:43 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:01:43 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:01:43 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:01:43 user nova-compute[70645]:     </memballoon>
Jul 24 15:01:43 user nova-compute[70645]:   </devices>
Jul 24 15:01:43 user nova-compute[70645]: </domain>
Jul 24 15:01:43 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887972996',display_name='tempest-ServerActionsTestOtherB-server-1887972996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887972996',id=14,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMleqYhBZCEEjJJsaMEuckPLdRSggssXX58+jSUDWV4RWgJi1aCvZ7GKXmFcDgd20RUebLSGWW0+tvwfBRktv2c+QmVz9Ve3ikoCtp5+5Q7Q8T6xY4TIWukXrdzPtz1wFA==',key_name='tempest-keypair-1765023642',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:59:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a7fb98af2b84c51a448d39d957f5f6a',ramdisk_id='',reservation_id='r-fex15wu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-589948319',owner_user_name='tempest-ServerActionsTestOtherB-589948319-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01c8ead2665a44c8a24dd89ee3b18a72',uuid=460ae655-2955-4a45-9b12-2a3ddd9f448b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converting VIF {"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG os_vif [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a56f8d6-1f, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a56f8d6-1f, col_values=(('external_ids', {'iface-id': '3a56f8d6-1f50-46b0-949f-a64d933dd392', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:ef:9d', 'vm-uuid': '460ae655-2955-4a45-9b12-2a3ddd9f448b'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:01:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:43 user nova-compute[70645]: INFO os_vif [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f')
Jul 24 15:01:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-8a19e17a-d747-441f-b34e-fabec7b9222a req-b755d304-be82-46dc-947a-eb16b29a9c57 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:01:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8a19e17a-d747-441f-b34e-fabec7b9222a req-b755d304-be82-46dc-947a-eb16b29a9c57 service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8a19e17a-d747-441f-b34e-fabec7b9222a req-b755d304-be82-46dc-947a-eb16b29a9c57 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8a19e17a-d747-441f-b34e-fabec7b9222a req-b755d304-be82-46dc-947a-eb16b29a9c57 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-8a19e17a-d747-441f-b34e-fabec7b9222a req-b755d304-be82-46dc-947a-eb16b29a9c57 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:01:45 user nova-compute[70645]: WARNING nova.compute.manager [req-8a19e17a-d747-441f-b34e-fabec7b9222a req-b755d304-be82-46dc-947a-eb16b29a9c57 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received unexpected event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with vm_state resized and task_state resize_reverting.
Jul 24 15:01:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 460ae655-2955-4a45-9b12-2a3ddd9f448b due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 15:01:47 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210907.126797, 460ae655-2955-4a45-9b12-2a3ddd9f448b => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:01:47 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] VM Resumed (Lifecycle Event)
Jul 24 15:01:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:01:47 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance running successfully.
Jul 24 15:01:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] finish_revert_migration finished successfully. {{(pid=70645) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 24 15:01:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:01:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:01:47 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 24 15:01:47 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210907.1361418, 460ae655-2955-4a45-9b12-2a3ddd9f448b => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:01:47 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] VM Started (Lifecycle Event)
Jul 24 15:01:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:01:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:01:47 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 24 15:01:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-c9f1e345-ff2c-48fd-b81d-43fec6894285 req-7cf09910-8278-41a4-afc4-d19f1e019758 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:01:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c9f1e345-ff2c-48fd-b81d-43fec6894285 req-7cf09910-8278-41a4-afc4-d19f1e019758 service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:01:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c9f1e345-ff2c-48fd-b81d-43fec6894285 req-7cf09910-8278-41a4-afc4-d19f1e019758 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:01:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c9f1e345-ff2c-48fd-b81d-43fec6894285 req-7cf09910-8278-41a4-afc4-d19f1e019758 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:01:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-c9f1e345-ff2c-48fd-b81d-43fec6894285 req-7cf09910-8278-41a4-afc4-d19f1e019758 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:01:47 user nova-compute[70645]: WARNING nova.compute.manager [req-c9f1e345-ff2c-48fd-b81d-43fec6894285 req-7cf09910-8278-41a4-afc4-d19f1e019758 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received unexpected event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with vm_state resized and task_state resize_reverting.
Jul 24 15:01:47 user nova-compute[70645]: INFO nova.compute.manager [None req-430a65a8-95d5-47b2-af78-783021560e7f tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating instance to original state: 'active'
Jul 24 15:01:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:01:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "c6738501-d019-48cb-b527-852fd6d61043" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "c6738501-d019-48cb-b527-852fd6d61043" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "c6738501-d019-48cb-b527-852fd6d61043-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "c6738501-d019-48cb-b527-852fd6d61043-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "c6738501-d019-48cb-b527-852fd6d61043-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:03 user nova-compute[70645]: INFO nova.compute.manager [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Terminating instance
Jul 24 15:02:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-d14f2a42-69ee-4599-9acb-5bb139d13da6 req-3f9660e3-d6e7-4843-88e6-dbdcb56ed5f0 service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Received event network-vif-unplugged-bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d14f2a42-69ee-4599-9acb-5bb139d13da6 req-3f9660e3-d6e7-4843-88e6-dbdcb56ed5f0 service nova] Acquiring lock "c6738501-d019-48cb-b527-852fd6d61043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d14f2a42-69ee-4599-9acb-5bb139d13da6 req-3f9660e3-d6e7-4843-88e6-dbdcb56ed5f0 service nova] Lock "c6738501-d019-48cb-b527-852fd6d61043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d14f2a42-69ee-4599-9acb-5bb139d13da6 req-3f9660e3-d6e7-4843-88e6-dbdcb56ed5f0 service nova] Lock "c6738501-d019-48cb-b527-852fd6d61043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-d14f2a42-69ee-4599-9acb-5bb139d13da6 req-3f9660e3-d6e7-4843-88e6-dbdcb56ed5f0 service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] No waiting events found dispatching network-vif-unplugged-bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-d14f2a42-69ee-4599-9acb-5bb139d13da6 req-3f9660e3-d6e7-4843-88e6-dbdcb56ed5f0 service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Received event network-vif-unplugged-bde05f3b-6be8-471d-8766-735296f70bb5 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:03 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: c6738501-d019-48cb-b527-852fd6d61043] Instance destroyed successfully.
Jul 24 15:02:03 user nova-compute[70645]: DEBUG nova.objects.instance [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lazy-loading 'resources' on Instance uuid c6738501-d019-48cb-b527-852fd6d61043 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1637723079',display_name='tempest-VolumesActionsTest-instance-1637723079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1637723079',id=23,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:00:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68682834554049928782963eab8ea32b',ramdisk_id='',reservation_id='r-ycfrs96m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1302908910',owner_user_name='tempest-VolumesActionsTest-1302908910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:00:20Z,user_data=None,user_id='b715d50164af4254aecf7156d617fa34',uuid=c6738501-d019-48cb-b527-852fd6d61043,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bde05f3b-6be8-471d-8766-735296f70bb5", "address": "fa:16:3e:0e:48:7e", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde05f3b-6b", "ovs_interfaceid": "bde05f3b-6be8-471d-8766-735296f70bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converting VIF {"id": "bde05f3b-6be8-471d-8766-735296f70bb5", "address": "fa:16:3e:0e:48:7e", "network": {"id": "aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1708373769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68682834554049928782963eab8ea32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde05f3b-6b", "ovs_interfaceid": "bde05f3b-6be8-471d-8766-735296f70bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:48:7e,bridge_name='br-int',has_traffic_filtering=True,id=bde05f3b-6be8-471d-8766-735296f70bb5,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde05f3b-6b') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG os_vif [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:48:7e,bridge_name='br-int',has_traffic_filtering=True,id=bde05f3b-6be8-471d-8766-735296f70bb5,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde05f3b-6b') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbde05f3b-6b, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:03 user nova-compute[70645]: INFO os_vif [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:48:7e,bridge_name='br-int',has_traffic_filtering=True,id=bde05f3b-6be8-471d-8766-735296f70bb5,network=Network(aa43b6e4-08bc-4c04-93c2-3a0bbb24f9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde05f3b-6b')
Jul 24 15:02:03 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Deleting instance files /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043_del
Jul 24 15:02:03 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Deletion of /opt/stack/data/nova/instances/c6738501-d019-48cb-b527-852fd6d61043_del complete
Jul 24 15:02:03 user nova-compute[70645]: INFO nova.compute.manager [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] [instance: c6738501-d019-48cb-b527-852fd6d61043] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 24 15:02:03 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: c6738501-d019-48cb-b527-852fd6d61043] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:02:03 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: c6738501-d019-48cb-b527-852fd6d61043] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: c6738501-d019-48cb-b527-852fd6d61043] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:02:04 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: c6738501-d019-48cb-b527-852fd6d61043] Took 0.54 seconds to deallocate network for instance.
Jul 24 15:02:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-50cb9527-3b97-4a4c-9402-9b308617f04e req-903968ac-c653-4118-8844-dfe9b935ce9a service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Received event network-vif-deleted-bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:04 user nova-compute[70645]: INFO nova.compute.manager [req-50cb9527-3b97-4a4c-9402-9b308617f04e req-903968ac-c653-4118-8844-dfe9b935ce9a service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Neutron deleted interface bde05f3b-6be8-471d-8766-735296f70bb5; detaching it from the instance and deleting it from the info cache
Jul 24 15:02:04 user nova-compute[70645]: DEBUG nova.network.neutron [req-50cb9527-3b97-4a4c-9402-9b308617f04e req-903968ac-c653-4118-8844-dfe9b935ce9a service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-50cb9527-3b97-4a4c-9402-9b308617f04e req-903968ac-c653-4118-8844-dfe9b935ce9a service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Detach interface failed, port_id=bde05f3b-6be8-471d-8766-735296f70bb5, reason: Instance c6738501-d019-48cb-b527-852fd6d61043 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:04 user nova-compute[70645]: INFO nova.compute.manager [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Unshelving
Jul 24 15:02:04 user nova-compute[70645]: INFO nova.virt.block_device [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Booting with volume e3f27e19-7b39-459d-845b-bc45924f64d2 at /dev/vdc
Jul 24 15:02:04 user nova-compute[70645]: DEBUG os_brick.utils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[48effd00-f4cc-43a6-b80e-fa638497fb6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5286af3-b15a-4564-903e-ec83074b1ec3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[912f8103-fa1b-4e83-bc83-2341ed0895c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[54882511-1a09-45f7-982a-ed2fead79c13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:02:04 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:02:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca2dfc2-e172-4e2c-820e-4b5cd08e2b45]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG os_brick.utils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updating existing volume attachment record: 89a93ef4-4a4b-4f37-9e6c-51ca56f54e06 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:02:04 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:02:05 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:02:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:05 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Deleted allocations for instance c6738501-d019-48cb-b527-852fd6d61043
Jul 24 15:02:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06ec3b4c-06c1-4f11-bf83-6e12dfc1ad9b tempest-VolumesActionsTest-1302908910 tempest-VolumesActionsTest-1302908910-project-member] Lock "c6738501-d019-48cb-b527-852fd6d61043" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.153s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-e272cd2f-a75e-4ce5-980b-06bc7d7bfb4b req-bac7d8a9-610b-4136-a847-1b1fd8247a3b service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Received event network-vif-plugged-bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e272cd2f-a75e-4ce5-980b-06bc7d7bfb4b req-bac7d8a9-610b-4136-a847-1b1fd8247a3b service nova] Acquiring lock "c6738501-d019-48cb-b527-852fd6d61043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e272cd2f-a75e-4ce5-980b-06bc7d7bfb4b req-bac7d8a9-610b-4136-a847-1b1fd8247a3b service nova] Lock "c6738501-d019-48cb-b527-852fd6d61043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e272cd2f-a75e-4ce5-980b-06bc7d7bfb4b req-bac7d8a9-610b-4136-a847-1b1fd8247a3b service nova] Lock "c6738501-d019-48cb-b527-852fd6d61043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-e272cd2f-a75e-4ce5-980b-06bc7d7bfb4b req-bac7d8a9-610b-4136-a847-1b1fd8247a3b service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] No waiting events found dispatching network-vif-plugged-bde05f3b-6be8-471d-8766-735296f70bb5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:02:05 user nova-compute[70645]: WARNING nova.compute.manager [req-e272cd2f-a75e-4ce5-980b-06bc7d7bfb4b req-bac7d8a9-610b-4136-a847-1b1fd8247a3b service nova] [instance: c6738501-d019-48cb-b527-852fd6d61043] Received unexpected event network-vif-plugged-bde05f3b-6be8-471d-8766-735296f70bb5 for instance with vm_state deleted and task_state None.
Jul 24 15:02:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:11 user nova-compute[70645]: DEBUG nova.objects.instance [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'pci_requests' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:11 user nova-compute[70645]: DEBUG nova.objects.instance [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:11 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:02:11 user nova-compute[70645]: INFO nova.compute.claims [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Claim successful on node user
Jul 24 15:02:12 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:02:12 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:02:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:12 user nova-compute[70645]: INFO nova.network.neutron [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updating port 84e43646-0d11-4aad-8ace-40d9d0d4aacc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 24 15:02:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:02:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquired lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:02:12 user nova-compute[70645]: DEBUG nova.network.neutron [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:02:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-b330bde3-572a-44bd-9f76-da0580842f46 req-215c53ad-9728-4831-9bbf-01dfedf35236 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-changed-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-b330bde3-572a-44bd-9f76-da0580842f46 req-215c53ad-9728-4831-9bbf-01dfedf35236 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Refreshing instance network info cache due to event network-changed-84e43646-0d11-4aad-8ace-40d9d0d4aacc. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:02:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b330bde3-572a-44bd-9f76-da0580842f46 req-215c53ad-9728-4831-9bbf-01dfedf35236 service nova] Acquiring lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:02:13 user nova-compute[70645]: DEBUG nova.network.neutron [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updating instance_info_cache with network_info: [{"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:02:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Releasing lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:02:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:02:13 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Creating image(s)
Jul 24 15:02:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "/opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "/opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:13 user nova-compute[70645]: DEBUG nova.objects.instance [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b330bde3-572a-44bd-9f76-da0580842f46 req-215c53ad-9728-4831-9bbf-01dfedf35236 service nova] Acquired lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:02:13 user nova-compute[70645]: DEBUG nova.network.neutron [req-b330bde3-572a-44bd-9f76-da0580842f46 req-215c53ad-9728-4831-9bbf-01dfedf35236 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Refreshing network info cache for port 84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:02:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "99f14164b57e0f43963836ef5fd64c6fceebc6b4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "99f14164b57e0f43963836ef5fd64c6fceebc6b4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4.part --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4.part --force-share --output=json" returned: 0 in 0.295s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:14 user nova-compute[70645]: DEBUG nova.virt.images [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] ccfae695-e065-4342-adbe-fee99b0c1dac was qcow2, converting to raw {{(pid=70645) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 15:02:14 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 15:02:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4.part /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4.converted {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:14 user nova-compute[70645]: DEBUG nova.network.neutron [req-b330bde3-572a-44bd-9f76-da0580842f46 req-215c53ad-9728-4831-9bbf-01dfedf35236 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updated VIF entry in instance network info cache for port 84e43646-0d11-4aad-8ace-40d9d0d4aacc. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:02:14 user nova-compute[70645]: DEBUG nova.network.neutron [req-b330bde3-572a-44bd-9f76-da0580842f46 req-215c53ad-9728-4831-9bbf-01dfedf35236 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updating instance_info_cache with network_info: [{"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:02:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b330bde3-572a-44bd-9f76-da0580842f46 req-215c53ad-9728-4831-9bbf-01dfedf35236 service nova] Releasing lock "refresh_cache-9ea99927-77d9-4e98-b435-d4c781031d90" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4.part /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4.converted" returned: 0 in 0.235s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4.converted --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "99f14164b57e0f43963836ef5fd64c6fceebc6b4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.811s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4 --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4 --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "99f14164b57e0f43963836ef5fd64c6fceebc6b4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "99f14164b57e0f43963836ef5fd64c6fceebc6b4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4 --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4 --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4,backing_fmt=raw /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4,backing_fmt=raw /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk 1073741824" returned: 0 in 0.050s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "99f14164b57e0f43963836ef5fd64c6fceebc6b4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4 --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4 --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG nova.objects.instance [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'migration_context' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:15 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Rebasing disk image.
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b -F raw /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b -F raw /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk" returned: 0 in 2.506s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Ensure instance console log exists: /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Start _get_guest_xml network_info=[{"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='296690e3fb6456c3fa10e295c4a7c843',container_format='bare',created_at=2023-07-24T15:00:11Z,direct_url=<?>,disk_format='qcow2',id=ccfae695-e065-4342-adbe-fee99b0c1dac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1918489519-shelved',owner='5d01222b2028429fae08bb542e5cd9cc',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-24T15:00:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '89a93ef4-4a4b-4f37-9e6c-51ca56f54e06', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqHOLcKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '9ea99927-77d9-4e98-b435-d4c781031d90', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3f27e19-7b39-459d-845b-bc45924f64d2', 'serial': 'e3f27e19-7b39-459d-845b-bc45924f64d2'}, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:02:18 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:02:18 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='296690e3fb6456c3fa10e295c4a7c843',container_format='bare',created_at=2023-07-24T15:00:11Z,direct_url=<?>,disk_format='qcow2',id=ccfae695-e065-4342-adbe-fee99b0c1dac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1918489519-shelved',owner='5d01222b2028429fae08bb542e5cd9cc',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-24T15:00:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.objects.instance [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqHOLcKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:02:18 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:02:18 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:02:18 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260" returned: 21 in 0.087s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f51399-216c-477d-82cf-0dc7af834ac4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:02:18 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[267f4bba-4ac9-46c4-b672-9b4c6323be71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2] added
Jul 24 15:02:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7073b8d-e45b-437b-95ec-23f86c7afcfe]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9248f24-fdbf-4e26-ae3c-33d91ad78651]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EqHOLcKa {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EqHOLcKa" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a754f6-115f-4941-a872-99707e9a7974]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EqHOLcKa'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdceac07-b994-48e8-8d0e-05b1292d394e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fd75de-e2e3-408f-b4be-e5d9487d7663]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9bbd85-ef28-47a0-bdf2-36380f9e546f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2, portal: 172.16.0.220,3260]
Jul 24 15:02:18 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2, portal: 172.16.0.220,3260] successful.
Jul 24 15:02:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6b598e-bcc0-4b2f-9f2a-28b85d5a3e01]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1927cc72-be64-436b-8ad4-faef1f41c412]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:02:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690210923.7879531, c6738501-d019-48cb-b527-852fd6d61043 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:02:18 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: c6738501-d019-48cb-b527-852fd6d61043] VM Stopped (Lifecycle Event)
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0407fe1-75e0-4f38-ac5e-1b0c02efb25f]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqHOLcKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-697ce11e-5769-4843-ae22-2ced51661765 None None] [instance: c6738501-d019-48cb-b527-852fd6d61043] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:18 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26162336236333831', 'path': '/dev/sdf'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162336236333831', 'path': '/dev/sdf'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T14:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1918489519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1918489519',id=21,image_ref='ccfae695-e065-4342-adbe-fee99b0c1dac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2073152801',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-gcl1160i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member',shelved_at='2023-07-24T15:00:16.913945',shelved_host='user',shelved_image_id='ccfae695-e065-4342-adbe-fee99b0c1dac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=9ea99927-77d9-4e98-b435-d4c781031d90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG nova.objects.instance [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:02:19 user nova-compute[70645]:   <uuid>9ea99927-77d9-4e98-b435-d4c781031d90</uuid>
Jul 24 15:02:19 user nova-compute[70645]:   <name>instance-00000015</name>
Jul 24 15:02:19 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:02:19 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:02:19 user nova-compute[70645]:   <metadata>
Jul 24 15:02:19 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:02:19 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:02:19 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1918489519</nova:name>
Jul 24 15:02:19 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:02:18</nova:creationTime>
Jul 24 15:02:19 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:02:19 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:02:19 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:02:19 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:02:19 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:02:19 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:02:19 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:02:19 user nova-compute[70645]:       <nova:owner>
Jul 24 15:02:19 user nova-compute[70645]:         <nova:user uuid="d9ba00b9477d416ba510bf66b424c1f9">tempest-AttachVolumeShelveTestJSON-218162714-project-member</nova:user>
Jul 24 15:02:19 user nova-compute[70645]:         <nova:project uuid="5d01222b2028429fae08bb542e5cd9cc">tempest-AttachVolumeShelveTestJSON-218162714</nova:project>
Jul 24 15:02:19 user nova-compute[70645]:       </nova:owner>
Jul 24 15:02:19 user nova-compute[70645]:       <nova:root type="image" uuid="ccfae695-e065-4342-adbe-fee99b0c1dac"/>
Jul 24 15:02:19 user nova-compute[70645]:       <nova:ports>
Jul 24 15:02:19 user nova-compute[70645]:         <nova:port uuid="84e43646-0d11-4aad-8ace-40d9d0d4aacc">
Jul 24 15:02:19 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 15:02:19 user nova-compute[70645]:         </nova:port>
Jul 24 15:02:19 user nova-compute[70645]:       </nova:ports>
Jul 24 15:02:19 user nova-compute[70645]:     </nova:instance>
Jul 24 15:02:19 user nova-compute[70645]:   </metadata>
Jul 24 15:02:19 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:02:19 user nova-compute[70645]:     <system>
Jul 24 15:02:19 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:02:19 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:02:19 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:02:19 user nova-compute[70645]:       <entry name="serial">9ea99927-77d9-4e98-b435-d4c781031d90</entry>
Jul 24 15:02:19 user nova-compute[70645]:       <entry name="uuid">9ea99927-77d9-4e98-b435-d4c781031d90</entry>
Jul 24 15:02:19 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:02:19 user nova-compute[70645]:     </system>
Jul 24 15:02:19 user nova-compute[70645]:   </sysinfo>
Jul 24 15:02:19 user nova-compute[70645]:   <os>
Jul 24 15:02:19 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:02:19 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:02:19 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:02:19 user nova-compute[70645]:   </os>
Jul 24 15:02:19 user nova-compute[70645]:   <features>
Jul 24 15:02:19 user nova-compute[70645]:     <acpi/>
Jul 24 15:02:19 user nova-compute[70645]:     <apic/>
Jul 24 15:02:19 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:02:19 user nova-compute[70645]:   </features>
Jul 24 15:02:19 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:02:19 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:02:19 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:02:19 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:02:19 user nova-compute[70645]:   </clock>
Jul 24 15:02:19 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:02:19 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:02:19 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:02:19 user nova-compute[70645]:   </cpu>
Jul 24 15:02:19 user nova-compute[70645]:   <devices>
Jul 24 15:02:19 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:02:19 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:02:19 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk"/>
Jul 24 15:02:19 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:02:19 user nova-compute[70645]:     </disk>
Jul 24 15:02:19 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:02:19 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:02:19 user nova-compute[70645]:       <source dev="/dev/sdf"/>
Jul 24 15:02:19 user nova-compute[70645]:       <target dev="vdc" bus="virtio"/>
Jul 24 15:02:19 user nova-compute[70645]:       <serial>e3f27e19-7b39-459d-845b-bc45924f64d2</serial>
Jul 24 15:02:19 user nova-compute[70645]:     </disk>
Jul 24 15:02:19 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:02:19 user nova-compute[70645]:       <mac address="fa:16:3e:38:37:ef"/>
Jul 24 15:02:19 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:02:19 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:02:19 user nova-compute[70645]:       <target dev="tap84e43646-0d"/>
Jul 24 15:02:19 user nova-compute[70645]:     </interface>
Jul 24 15:02:19 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:02:19 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/console.log" append="off"/>
Jul 24 15:02:19 user nova-compute[70645]:     </serial>
Jul 24 15:02:19 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:02:19 user nova-compute[70645]:     <video>
Jul 24 15:02:19 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:02:19 user nova-compute[70645]:     </video>
Jul 24 15:02:19 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:02:19 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:02:19 user nova-compute[70645]:     </rng>
Jul 24 15:02:19 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:02:19 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:02:19 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:02:19 user nova-compute[70645]:     </memballoon>
Jul 24 15:02:19 user nova-compute[70645]:   </devices>
Jul 24 15:02:19 user nova-compute[70645]: </domain>
Jul 24 15:02:19 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T14:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1918489519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1918489519',id=21,image_ref='ccfae695-e065-4342-adbe-fee99b0c1dac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2073152801',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-gcl1160i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member',shelved_at='2023-07-24T15:00:16.913945',shelved_host='user',shelved_image_id='ccfae695-e065-4342-adbe-fee99b0c1dac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=9ea99927-77d9-4e98-b435-d4c781031d90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG os_vif [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84e43646-0d, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84e43646-0d, col_values=(('external_ids', {'iface-id': '84e43646-0d11-4aad-8ace-40d9d0d4aacc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:37:ef', 'vm-uuid': '9ea99927-77d9-4e98-b435-d4c781031d90'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:19 user nova-compute[70645]: INFO os_vif [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d')
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:02:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] No VIF found with MAC fa:16:3e:38:37:ef, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-1d44ccea-a515-46a0-b577-495096d78bf7 req-426d7474-1630-49e3-8bdc-62321793a947 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1d44ccea-a515-46a0-b577-495096d78bf7 req-426d7474-1630-49e3-8bdc-62321793a947 service nova] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1d44ccea-a515-46a0-b577-495096d78bf7 req-426d7474-1630-49e3-8bdc-62321793a947 service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1d44ccea-a515-46a0-b577-495096d78bf7 req-426d7474-1630-49e3-8bdc-62321793a947 service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-1d44ccea-a515-46a0-b577-495096d78bf7 req-426d7474-1630-49e3-8bdc-62321793a947 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] No waiting events found dispatching network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:02:21 user nova-compute[70645]: WARNING nova.compute.manager [req-1d44ccea-a515-46a0-b577-495096d78bf7 req-426d7474-1630-49e3-8bdc-62321793a947 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received unexpected event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:02:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:22 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:02:22 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7555MB free_disk=25.20526885986328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 6fafa215-3ee5-4efb-816a-1d9f72e667da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 734abf9a-96dd-40b4-9b68-2d42fa079216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 460ae655-2955-4a45-9b12-2a3ddd9f448b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 07adce07-b416-44fb-b548-17b8cd0d8168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (a0cf5b80-69d2-4191-894e-a498eab7d688): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquired lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'info_cache' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210943.7529767, 9ea99927-77d9-4e98-b435-d4c781031d90 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:02:23 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] VM Resumed (Lifecycle Event)
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:02:23 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance spawned successfully.
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:02:23 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210943.7542377, 9ea99927-77d9-4e98-b435-d4c781031d90 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:02:23 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] VM Started (Lifecycle Event)
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-77708288-077f-481d-ac41-1d7adfefc5c3 req-96baebef-f994-4e38-9bcc-7e78ce81cde1 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-77708288-077f-481d-ac41-1d7adfefc5c3 req-96baebef-f994-4e38-9bcc-7e78ce81cde1 service nova] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-77708288-077f-481d-ac41-1d7adfefc5c3 req-96baebef-f994-4e38-9bcc-7e78ce81cde1 service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-77708288-077f-481d-ac41-1d7adfefc5c3 req-96baebef-f994-4e38-9bcc-7e78ce81cde1 service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-77708288-077f-481d-ac41-1d7adfefc5c3 req-96baebef-f994-4e38-9bcc-7e78ce81cde1 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] No waiting events found dispatching network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:02:23 user nova-compute[70645]: WARNING nova.compute.manager [req-77708288-077f-481d-ac41-1d7adfefc5c3 req-96baebef-f994-4e38-9bcc-7e78ce81cde1 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received unexpected event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:02:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:02:23 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-676aff1e-1e2c-4d2c-9164-cfea55f76bec tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.457s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Updating instance_info_cache with network_info: [{"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Releasing lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:02:24 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance destroyed successfully.
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'resources' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1841824952',display_name='tempest-AttachVolumeTestJSON-server-1841824952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1841824952',id=22,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMLbkQBMsR4a+hDUBr6a7aRbORe6/on6xHkq0RJlZIGJHHSRDeijoBX284tbAvvwuA6Lxntt8t7PR2NgacxtAM+JNC3dlGGca1WYyP9ZD/+aBRiNcvf5TmXBq0Tu+cQQw==',key_name='tempest-keypair-548846795',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-x9wujour',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:00:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=734abf9a-96dd-40b4-9b68-2d42fa079216,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_vif [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap634fb15f-19, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:02:24 user nova-compute[70645]: INFO os_vif [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19')
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgHOotWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:02:24 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[568aae5b-8843-4559-afa0-3391dbdcc4ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6365035d-140f-4921-880a-8c98ba83b08f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbaa1cc04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0cafb0-daab-4db6-a940-e59d10979e9e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4fdc1f-8958-46e0-89d5-7e74c50f0b0e]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f044f4ab-d8ba-4a0b-9a78-134cdbff437a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc13063-3529-4fd4-9598-66e4d4216855]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2785fed6-c18c-4b32-90ba-a75ea2e2488d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[818b5dd6-ddc5-49f6-a47c-5b52e0e31174]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260]
Jul 24 15:02:24 user nova-compute[70645]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260] successful.
Jul 24 15:02:24 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65bfc2a-31ce-4958-b966-c5ab6ac68f1a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] <== disconnect_volume: return (303ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Start _get_guest_xml network_info=[{"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '67555386-81d6-4362-83f3-ebf0769c56bf', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgHOotWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '734abf9a-96dd-40b4-9b68-2d42fa079216', 'attached_at': '', 'detached_at': '', 'volume_id': '05b990d4-add3-45f4-9e5d-b3c9bc168e98', 'serial': '05b990d4-add3-45f4-9e5d-b3c9bc168e98'}, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'numa_topology' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:24 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:02:24 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'vcpu_model' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgHOotWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:02:24 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:02:24 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:02:24 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a59b959-0709-42c9-bbae-fa05a28fb640]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:02:24 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03ea96f-5766-43f2-9e10-4227cc3e13b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98] added
Jul 24 15:02:24 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdbb0bb-c4f5-4600-82b9-c4e5e15cb46d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ba394d-5e28-4cd2-b085-8456d0400504]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgHOotWJ {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgHOotWJ" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a28de81-cf9a-4c8e-b6e3-6aee1a393199]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xgHOotWJ'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c03fbe-7b14-450a-a33e-e464e5b666bf]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b571e7-00ee-43df-9a8e-c024664d503b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6c00f5-3bde-4925-8653-0a512d512086]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260]
Jul 24 15:02:24 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260] successful.
Jul 24 15:02:24 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a052091f-0d60-4fd7-bb4f-555a64e3e833]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e948eb30-59cd-4302-9961-14ab749ee548]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:02:24 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:02:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d050e13-4904-4d41-a429-f1b908747b41]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgHOotWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updating instance_info_cache with network_info: [{"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:02:25 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26537383530633466', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537383530633466', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1841824952',display_name='tempest-AttachVolumeTestJSON-server-1841824952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1841824952',id=22,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMLbkQBMsR4a+hDUBr6a7aRbORe6/on6xHkq0RJlZIGJHHSRDeijoBX284tbAvvwuA6Lxntt8t7PR2NgacxtAM+JNC3dlGGca1WYyP9ZD/+aBRiNcvf5TmXBq0Tu+cQQw==',key_name='tempest-keypair-548846795',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-x9wujour',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:00:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=734abf9a-96dd-40b4-9b68-2d42fa079216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'pci_devices' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:02:26 user nova-compute[70645]:   <uuid>734abf9a-96dd-40b4-9b68-2d42fa079216</uuid>
Jul 24 15:02:26 user nova-compute[70645]:   <name>instance-00000016</name>
Jul 24 15:02:26 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:02:26 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:02:26 user nova-compute[70645]:   <metadata>
Jul 24 15:02:26 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:02:26 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:02:26 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeTestJSON-server-1841824952</nova:name>
Jul 24 15:02:26 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:02:24</nova:creationTime>
Jul 24 15:02:26 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:02:26 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:02:26 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:02:26 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:02:26 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:02:26 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:02:26 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:02:26 user nova-compute[70645]:       <nova:owner>
Jul 24 15:02:26 user nova-compute[70645]:         <nova:user uuid="fa4b836a11a044a583cb21072f0e4922">tempest-AttachVolumeTestJSON-1397935195-project-member</nova:user>
Jul 24 15:02:26 user nova-compute[70645]:         <nova:project uuid="2dacb396f6be4936ac1c4d115bf98d6a">tempest-AttachVolumeTestJSON-1397935195</nova:project>
Jul 24 15:02:26 user nova-compute[70645]:       </nova:owner>
Jul 24 15:02:26 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:02:26 user nova-compute[70645]:       <nova:ports>
Jul 24 15:02:26 user nova-compute[70645]:         <nova:port uuid="634fb15f-19aa-462c-931b-dd76f2ce93b0">
Jul 24 15:02:26 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 15:02:26 user nova-compute[70645]:         </nova:port>
Jul 24 15:02:26 user nova-compute[70645]:       </nova:ports>
Jul 24 15:02:26 user nova-compute[70645]:     </nova:instance>
Jul 24 15:02:26 user nova-compute[70645]:   </metadata>
Jul 24 15:02:26 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:02:26 user nova-compute[70645]:     <system>
Jul 24 15:02:26 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:02:26 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:02:26 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:02:26 user nova-compute[70645]:       <entry name="serial">734abf9a-96dd-40b4-9b68-2d42fa079216</entry>
Jul 24 15:02:26 user nova-compute[70645]:       <entry name="uuid">734abf9a-96dd-40b4-9b68-2d42fa079216</entry>
Jul 24 15:02:26 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:02:26 user nova-compute[70645]:     </system>
Jul 24 15:02:26 user nova-compute[70645]:   </sysinfo>
Jul 24 15:02:26 user nova-compute[70645]:   <os>
Jul 24 15:02:26 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:02:26 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:02:26 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:02:26 user nova-compute[70645]:   </os>
Jul 24 15:02:26 user nova-compute[70645]:   <features>
Jul 24 15:02:26 user nova-compute[70645]:     <acpi/>
Jul 24 15:02:26 user nova-compute[70645]:     <apic/>
Jul 24 15:02:26 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:02:26 user nova-compute[70645]:   </features>
Jul 24 15:02:26 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:02:26 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:02:26 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:02:26 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:02:26 user nova-compute[70645]:   </clock>
Jul 24 15:02:26 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:02:26 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:02:26 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:02:26 user nova-compute[70645]:   </cpu>
Jul 24 15:02:26 user nova-compute[70645]:   <devices>
Jul 24 15:02:26 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:02:26 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:02:26 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk"/>
Jul 24 15:02:26 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:02:26 user nova-compute[70645]:     </disk>
Jul 24 15:02:26 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:02:26 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:02:26 user nova-compute[70645]:       <source dev="/dev/sdc"/>
Jul 24 15:02:26 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 15:02:26 user nova-compute[70645]:       <serial>05b990d4-add3-45f4-9e5d-b3c9bc168e98</serial>
Jul 24 15:02:26 user nova-compute[70645]:     </disk>
Jul 24 15:02:26 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:02:26 user nova-compute[70645]:       <mac address="fa:16:3e:c7:b9:c5"/>
Jul 24 15:02:26 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:02:26 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:02:26 user nova-compute[70645]:       <target dev="tap634fb15f-19"/>
Jul 24 15:02:26 user nova-compute[70645]:     </interface>
Jul 24 15:02:26 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:02:26 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/console.log" append="off"/>
Jul 24 15:02:26 user nova-compute[70645]:     </serial>
Jul 24 15:02:26 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:02:26 user nova-compute[70645]:     <video>
Jul 24 15:02:26 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:02:26 user nova-compute[70645]:     </video>
Jul 24 15:02:26 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:02:26 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:02:26 user nova-compute[70645]:     </rng>
Jul 24 15:02:26 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:02:26 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:02:26 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:02:26 user nova-compute[70645]:     </memballoon>
Jul 24 15:02:26 user nova-compute[70645]:   </devices>
Jul 24 15:02:26 user nova-compute[70645]: </domain>
Jul 24 15:02:26 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'trusted_certs' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Cannot resize image /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'migration_context' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1841824952',display_name='tempest-AttachVolumeTestJSON-server-1841824952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1841824952',id=22,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMLbkQBMsR4a+hDUBr6a7aRbORe6/on6xHkq0RJlZIGJHHSRDeijoBX284tbAvvwuA6Lxntt8t7PR2NgacxtAM+JNC3dlGGca1WYyP9ZD/+aBRiNcvf5TmXBq0Tu+cQQw==',key_name='tempest-keypair-548846795',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-x9wujour',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:00:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=734abf9a-96dd-40b4-9b68-2d42fa079216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG os_vif [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap634fb15f-19, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap634fb15f-19, col_values=(('external_ids', {'iface-id': '634fb15f-19aa-462c-931b-dd76f2ce93b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:b9:c5', 'vm-uuid': '734abf9a-96dd-40b4-9b68-2d42fa079216'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:02:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:26 user nova-compute[70645]: INFO os_vif [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19')
Jul 24 15:02:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-d198273a-5321-4d33-bb86-251fda224526 req-5bd278c3-4ca3-432c-b393-f319ad9e78ae service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d198273a-5321-4d33-bb86-251fda224526 req-5bd278c3-4ca3-432c-b393-f319ad9e78ae service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d198273a-5321-4d33-bb86-251fda224526 req-5bd278c3-4ca3-432c-b393-f319ad9e78ae service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d198273a-5321-4d33-bb86-251fda224526 req-5bd278c3-4ca3-432c-b393-f319ad9e78ae service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-d198273a-5321-4d33-bb86-251fda224526 req-5bd278c3-4ca3-432c-b393-f319ad9e78ae service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:02:28 user nova-compute[70645]: WARNING nova.compute.manager [req-d198273a-5321-4d33-bb86-251fda224526 req-5bd278c3-4ca3-432c-b393-f319ad9e78ae service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state stopped and task_state powering-on.
Jul 24 15:02:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:30 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210950.278993, 734abf9a-96dd-40b4-9b68-2d42fa079216 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:02:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] VM Resumed (Lifecycle Event)
Jul 24 15:02:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:02:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance rebooted successfully.
Jul 24 15:02:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7a740c45-9f96-4fa5-8a72-4b527ee65b08 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:02:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:02:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:02:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 24 15:02:30 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210950.2840433, 734abf9a-96dd-40b4-9b68-2d42fa079216 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:02:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] VM Started (Lifecycle Event)
Jul 24 15:02:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:02:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:02:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-9917ab2a-9901-4e99-b488-33ef79fbea49 req-9cbb6a97-0cb8-444b-9057-0a1dd5972d57 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9917ab2a-9901-4e99-b488-33ef79fbea49 req-9cbb6a97-0cb8-444b-9057-0a1dd5972d57 service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9917ab2a-9901-4e99-b488-33ef79fbea49 req-9cbb6a97-0cb8-444b-9057-0a1dd5972d57 service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9917ab2a-9901-4e99-b488-33ef79fbea49 req-9cbb6a97-0cb8-444b-9057-0a1dd5972d57 service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-9917ab2a-9901-4e99-b488-33ef79fbea49 req-9cbb6a97-0cb8-444b-9057-0a1dd5972d57 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:02:30 user nova-compute[70645]: WARNING nova.compute.manager [req-9917ab2a-9901-4e99-b488-33ef79fbea49 req-9cbb6a97-0cb8-444b-9057-0a1dd5972d57 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state active and task_state None.
Jul 24 15:02:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:38 user nova-compute[70645]: INFO nova.compute.manager [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Rescuing
Jul 24 15:02:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:02:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquired lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:02:38 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:02:38 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Updating instance_info_cache with network_info: [{"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:02:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Releasing lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-528ebdf7-3852-4120-b4c3-1e7ec9b20500 req-96012f67-2a68-4a6e-bae3-971bb3ac474c service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-unplugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-528ebdf7-3852-4120-b4c3-1e7ec9b20500 req-96012f67-2a68-4a6e-bae3-971bb3ac474c service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-528ebdf7-3852-4120-b4c3-1e7ec9b20500 req-96012f67-2a68-4a6e-bae3-971bb3ac474c service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-528ebdf7-3852-4120-b4c3-1e7ec9b20500 req-96012f67-2a68-4a6e-bae3-971bb3ac474c service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-528ebdf7-3852-4120-b4c3-1e7ec9b20500 req-96012f67-2a68-4a6e-bae3-971bb3ac474c service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-unplugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:02:39 user nova-compute[70645]: WARNING nova.compute.manager [req-528ebdf7-3852-4120-b4c3-1e7ec9b20500 req-96012f67-2a68-4a6e-bae3-971bb3ac474c service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received unexpected event network-vif-unplugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with vm_state active and task_state rescuing.
Jul 24 15:02:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:39 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Instance destroyed successfully.
Jul 24 15:02:39 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Attempting rescue
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70645) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Instance directory exists: not creating {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 15:02:39 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Creating image(s)
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "/opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'trusted_certs' on Instance uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.rescue {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.rescue" returned: 0 in 0.053s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'migration_context' on Instance uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Start _get_guest_xml network_info=[{"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "vif_mac": "fa:16:3e:ae:bb:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'resources' on Instance uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'numa_topology' on Instance uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:39 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:02:39 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998066313',display_name='tempest-ServerRescueNegativeTestJSON-server-998066313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998066313',id=19,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-8dcvtzzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T14:58:01Z,user_data=None,user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=74c53188-2399-4515-94e6-4ff3e94d7559,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "vif_mac": "fa:16:3e:ae:bb:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "vif_mac": "fa:16:3e:ae:bb:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=a4da7fd3-4861-41a6-ad8c-d9326d1b7160,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4da7fd3-48') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:02:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'pci_devices' on Instance uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:02:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:02:40 user nova-compute[70645]:   <uuid>74c53188-2399-4515-94e6-4ff3e94d7559</uuid>
Jul 24 15:02:40 user nova-compute[70645]:   <name>instance-00000013</name>
Jul 24 15:02:40 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:02:40 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:02:40 user nova-compute[70645]:   <metadata>
Jul 24 15:02:40 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:02:40 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:02:40 user nova-compute[70645]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-998066313</nova:name>
Jul 24 15:02:40 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:02:39</nova:creationTime>
Jul 24 15:02:40 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:02:40 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:02:40 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:02:40 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:02:40 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:02:40 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:02:40 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:02:40 user nova-compute[70645]:       <nova:owner>
Jul 24 15:02:40 user nova-compute[70645]:         <nova:user uuid="74440f1d0cf141fdb6b40b0d1e3a5d13">tempest-ServerRescueNegativeTestJSON-1652524619-project-member</nova:user>
Jul 24 15:02:40 user nova-compute[70645]:         <nova:project uuid="c3f8500e5a144902be74f12f3caf8ae2">tempest-ServerRescueNegativeTestJSON-1652524619</nova:project>
Jul 24 15:02:40 user nova-compute[70645]:       </nova:owner>
Jul 24 15:02:40 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:02:40 user nova-compute[70645]:       <nova:ports>
Jul 24 15:02:40 user nova-compute[70645]:         <nova:port uuid="a4da7fd3-4861-41a6-ad8c-d9326d1b7160">
Jul 24 15:02:40 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 15:02:40 user nova-compute[70645]:         </nova:port>
Jul 24 15:02:40 user nova-compute[70645]:       </nova:ports>
Jul 24 15:02:40 user nova-compute[70645]:     </nova:instance>
Jul 24 15:02:40 user nova-compute[70645]:   </metadata>
Jul 24 15:02:40 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:02:40 user nova-compute[70645]:     <system>
Jul 24 15:02:40 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:02:40 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:02:40 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:02:40 user nova-compute[70645]:       <entry name="serial">74c53188-2399-4515-94e6-4ff3e94d7559</entry>
Jul 24 15:02:40 user nova-compute[70645]:       <entry name="uuid">74c53188-2399-4515-94e6-4ff3e94d7559</entry>
Jul 24 15:02:40 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:02:40 user nova-compute[70645]:     </system>
Jul 24 15:02:40 user nova-compute[70645]:   </sysinfo>
Jul 24 15:02:40 user nova-compute[70645]:   <os>
Jul 24 15:02:40 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:02:40 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:02:40 user nova-compute[70645]:   </os>
Jul 24 15:02:40 user nova-compute[70645]:   <features>
Jul 24 15:02:40 user nova-compute[70645]:     <acpi/>
Jul 24 15:02:40 user nova-compute[70645]:     <apic/>
Jul 24 15:02:40 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:02:40 user nova-compute[70645]:   </features>
Jul 24 15:02:40 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:02:40 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:02:40 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:02:40 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:02:40 user nova-compute[70645]:   </clock>
Jul 24 15:02:40 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:02:40 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:02:40 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:02:40 user nova-compute[70645]:   </cpu>
Jul 24 15:02:40 user nova-compute[70645]:   <devices>
Jul 24 15:02:40 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:02:40 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:02:40 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.rescue"/>
Jul 24 15:02:40 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:02:40 user nova-compute[70645]:     </disk>
Jul 24 15:02:40 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:02:40 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:02:40 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk"/>
Jul 24 15:02:40 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 15:02:40 user nova-compute[70645]:     </disk>
Jul 24 15:02:40 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:02:40 user nova-compute[70645]:       <mac address="fa:16:3e:ae:bb:83"/>
Jul 24 15:02:40 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:02:40 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:02:40 user nova-compute[70645]:       <target dev="tapa4da7fd3-48"/>
Jul 24 15:02:40 user nova-compute[70645]:     </interface>
Jul 24 15:02:40 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:02:40 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/console.log" append="off"/>
Jul 24 15:02:40 user nova-compute[70645]:     </serial>
Jul 24 15:02:40 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:02:40 user nova-compute[70645]:     <video>
Jul 24 15:02:40 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:02:40 user nova-compute[70645]:     </video>
Jul 24 15:02:40 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:02:40 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:02:40 user nova-compute[70645]:     </rng>
Jul 24 15:02:40 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:02:40 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:02:40 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:02:40 user nova-compute[70645]:     </memballoon>
Jul 24 15:02:40 user nova-compute[70645]:   </devices>
Jul 24 15:02:40 user nova-compute[70645]: </domain>
Jul 24 15:02:40 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:02:40 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Instance destroyed successfully.
Jul 24 15:02:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:02:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:02:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No VIF found with MAC fa:16:3e:ae:bb:83, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-ff64ea31-076f-4ae2-9fc0-0edb9323422f req-cf157ee5-ec05-4933-bf79-8cfde4259979 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ff64ea31-076f-4ae2-9fc0-0edb9323422f req-cf157ee5-ec05-4933-bf79-8cfde4259979 service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ff64ea31-076f-4ae2-9fc0-0edb9323422f req-cf157ee5-ec05-4933-bf79-8cfde4259979 service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ff64ea31-076f-4ae2-9fc0-0edb9323422f req-cf157ee5-ec05-4933-bf79-8cfde4259979 service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-ff64ea31-076f-4ae2-9fc0-0edb9323422f req-cf157ee5-ec05-4933-bf79-8cfde4259979 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:02:41 user nova-compute[70645]: WARNING nova.compute.manager [req-ff64ea31-076f-4ae2-9fc0-0edb9323422f req-cf157ee5-ec05-4933-bf79-8cfde4259979 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received unexpected event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with vm_state active and task_state rescuing.
Jul 24 15:02:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 74c53188-2399-4515-94e6-4ff3e94d7559 due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210963.461902, 74c53188-2399-4515-94e6-4ff3e94d7559 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:02:43 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] VM Resumed (Lifecycle Event)
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:02:43 user nova-compute[70645]: WARNING nova.compute.manager [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received unexpected event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with vm_state active and task_state rescuing.
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:02:43 user nova-compute[70645]: WARNING nova.compute.manager [req-f86c278b-a255-4d8f-a545-2300f6b312b4 req-05f880fa-8ceb-43cf-a5e1-18d3be37e63a service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received unexpected event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with vm_state active and task_state rescuing.
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0b569c69-900e-4480-8a35-ff61234fc10c tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:02:43 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690210963.4720154, 74c53188-2399-4515-94e6-4ff3e94d7559 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:02:43 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] VM Started (Lifecycle Event)
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:02:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:02:44 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:02:44 user nova-compute[70645]: INFO nova.compute.manager [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] instance snapshotting
Jul 24 15:02:44 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Beginning live snapshot process
Jul 24 15:02:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json -f qcow2 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json -f qcow2 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpivgyfofe/a97f435d16db4382b2041e22aef8c1cb.delta 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpivgyfofe/a97f435d16db4382b2041e22aef8c1cb.delta 1073741824" returned: 0 in 0.049s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:45 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 15:02:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 15:02:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 15:02:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 15:02:46 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 15:02:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpivgyfofe/a97f435d16db4382b2041e22aef8c1cb.delta /opt/stack/data/nova/instances/snapshots/tmpivgyfofe/a97f435d16db4382b2041e22aef8c1cb {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:02:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpivgyfofe/a97f435d16db4382b2041e22aef8c1cb.delta /opt/stack/data/nova/instances/snapshots/tmpivgyfofe/a97f435d16db4382b2041e22aef8c1cb" returned: 0 in 0.291s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:02:47 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Snapshot extracted, beginning image upload
Jul 24 15:02:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Snapshot image upload complete
Jul 24 15:02:49 user nova-compute[70645]: INFO nova.compute.manager [None req-4075efe9-a0a7-46b8-805b-4a75892f765a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Took 5.03 seconds to snapshot the instance on the hypervisor.
Jul 24 15:02:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:02:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:12 user nova-compute[70645]: INFO nova.compute.manager [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Detaching volume 59b95f50-3060-48ab-b66b-9465011bb8f7
Jul 24 15:03:12 user nova-compute[70645]: INFO nova.virt.block_device [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Attempting to driver detach volume 59b95f50-3060-48ab-b66b-9465011bb8f7 from mountpoint /dev/vdb
Jul 24 15:03:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Attempting to detach device vdb from instance 20469e51-a240-48ea-bdf4-f7a59d129232 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:03:12 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:03:12 user nova-compute[70645]:   <source dev="/dev/sdd"/>
Jul 24 15:03:12 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:03:12 user nova-compute[70645]:   <serial>59b95f50-3060-48ab-b66b-9465011bb8f7</serial>
Jul 24 15:03:12 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 15:03:12 user nova-compute[70645]: </disk>
Jul 24 15:03:12 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:03:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Successfully detached device vdb from instance 20469e51-a240-48ea-bdf4-f7a59d129232 from the persistent domain config.
Jul 24 15:03:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20469e51-a240-48ea-bdf4-f7a59d129232 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:03:12 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:03:12 user nova-compute[70645]:   <source dev="/dev/sdd"/>
Jul 24 15:03:12 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:03:12 user nova-compute[70645]:   <serial>59b95f50-3060-48ab-b66b-9465011bb8f7</serial>
Jul 24 15:03:12 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 15:03:12 user nova-compute[70645]: </disk>
Jul 24 15:03:12 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690210992.809231, 20469e51-a240-48ea-bdf4-f7a59d129232 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:03:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Successfully detached device vdb from instance 20469e51-a240-48ea-bdf4-f7a59d129232 from the live domain config.
Jul 24 15:03:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwyAHPbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:03:12 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:03:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8dcf8d-d992-42e6-9774-b5755115c77a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d32aa6ed-6bd0-47db-b43d-06846f3331ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eab2b91-df6f-4390-9f91-a07cbf9cc129]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d32aa6ed-6bd0-47db-b43d-06846f3331ba (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d32aa6ed-6bd0-47db-b43d-06846f3331ba (non-flash)
Jul 24 15:03:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:12 user nova-compute[70645]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d32aa6ed-6bd0-47db-b43d-06846f3331ba (non-flash)
Jul 24 15:03:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba941a7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7'): ({'sdd'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Removing single pathed devices sdd {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.047s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[776be5cc-09bd-42bc-bf8c-697a4f609bc5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee0be8-a7ac-4de5-9a42-69140bbc93f1]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flushing IO for device /dev/sdd {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a4552-7565-4a04-b7f6-745cbbc2ca82]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:03:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb720cf3-b6df-4422-94b9-19faa3a7380f]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c19759f-2158-4747-8663-b6dc84fb3c6e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6622d097-d656-49d9-b692-28be9c1a7ec8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260]
Jul 24 15:03:13 user nova-compute[70645]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7, portal: 172.16.0.220,3260] successful.
Jul 24 15:03:13 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b95f50-3060-48ab-b66b-9465011bb8f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bc04a2-f067-4f29-a39f-e1546cd5ed72]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== disconnect_volume: return (337ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:03:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:03:14 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'flavor' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:03:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c87a7d03-0a60-404d-bad9-0e5cecd2b936 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.911s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:18 user nova-compute[70645]: INFO nova.compute.manager [None req-7ddb62a7-1497-470b-a311-9b1461525cce tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Unrescuing
Jul 24 15:03:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7ddb62a7-1497-470b-a311-9b1461525cce tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:03:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7ddb62a7-1497-470b-a311-9b1461525cce tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquired lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:03:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7ddb62a7-1497-470b-a311-9b1461525cce tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:03:18 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7ddb62a7-1497-470b-a311-9b1461525cce tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updating instance_info_cache with network_info: [{"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7ddb62a7-1497-470b-a311-9b1461525cce tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Releasing lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7ddb62a7-1497-470b-a311-9b1461525cce tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'flavor' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-509f9ae4-adf7-4b53-8611-2ea03a3d0502 req-7da72377-e3c2-4f4f-86ed-c1d219d3508c service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Received event network-changed-30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-509f9ae4-adf7-4b53-8611-2ea03a3d0502 req-7da72377-e3c2-4f4f-86ed-c1d219d3508c service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Refreshing instance network info cache due to event network-changed-30e4879f-dced-4de7-92f5-251b88dc5a8c. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-509f9ae4-adf7-4b53-8611-2ea03a3d0502 req-7da72377-e3c2-4f4f-86ed-c1d219d3508c service nova] Acquiring lock "refresh_cache-5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-509f9ae4-adf7-4b53-8611-2ea03a3d0502 req-7da72377-e3c2-4f4f-86ed-c1d219d3508c service nova] Acquired lock "refresh_cache-5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG nova.network.neutron [req-509f9ae4-adf7-4b53-8611-2ea03a3d0502 req-7da72377-e3c2-4f4f-86ed-c1d219d3508c service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Refreshing network info cache for port 30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'flavor' on Instance uuid 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:03:19 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Ignoring supplied device name: /dev/vdb
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-3c679bbb-1cfb-46b9-af79-932e8d4a3d91 req-deb9e730-c2ff-442f-bf98-29c6e0081462 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-unplugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3c679bbb-1cfb-46b9-af79-932e8d4a3d91 req-deb9e730-c2ff-442f-bf98-29c6e0081462 service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3c679bbb-1cfb-46b9-af79-932e8d4a3d91 req-deb9e730-c2ff-442f-bf98-29c6e0081462 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3c679bbb-1cfb-46b9-af79-932e8d4a3d91 req-deb9e730-c2ff-442f-bf98-29c6e0081462 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-3c679bbb-1cfb-46b9-af79-932e8d4a3d91 req-deb9e730-c2ff-442f-bf98-29c6e0081462 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-unplugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:03:19 user nova-compute[70645]: WARNING nova.compute.manager [req-3c679bbb-1cfb-46b9-af79-932e8d4a3d91 req-deb9e730-c2ff-442f-bf98-29c6e0081462 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received unexpected event network-vif-unplugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:19 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:20 user nova-compute[70645]: INFO nova.compute.manager [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Attaching volume f1f7df33-6394-4176-9086-94015c10ef40 to /dev/vdb
Jul 24 15:03:20 user nova-compute[70645]: DEBUG os_brick.utils [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd1cf56-9c02-41e1-9d50-4d2ac6c2aaa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a0ba43-3947-4969-873e-7ffd23e27ee8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[81391d28-2d9a-4b28-a969-ef99182cc7d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13751b4-49ac-4444-bd42-911e080a3bb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:03:20 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb711a3-ca61-444e-89ff-1c6ea44b0819]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG os_brick.utils [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Updating existing volume attachment record: c5503cc6-46f4-44e7-a5c8-093c6e1a8e63 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:03:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Instance destroyed successfully.
Jul 24 15:03:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-352bae7b-ebc8-4336-9edf-349b897ca8a6 req-00409551-7456-46af-ac77-8dd768fc967f service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-changed-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-352bae7b-ebc8-4336-9edf-349b897ca8a6 req-00409551-7456-46af-ac77-8dd768fc967f service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Refreshing instance network info cache due to event network-changed-02ca6838-89e2-41bc-a858-dc7a007f7960. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-352bae7b-ebc8-4336-9edf-349b897ca8a6 req-00409551-7456-46af-ac77-8dd768fc967f service nova] Acquiring lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-352bae7b-ebc8-4336-9edf-349b897ca8a6 req-00409551-7456-46af-ac77-8dd768fc967f service nova] Acquired lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG nova.network.neutron [req-352bae7b-ebc8-4336-9edf-349b897ca8a6 req-00409551-7456-46af-ac77-8dd768fc967f service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Refreshing network info cache for port 02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG nova.network.neutron [req-509f9ae4-adf7-4b53-8611-2ea03a3d0502 req-7da72377-e3c2-4f4f-86ed-c1d219d3508c service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Updated VIF entry in instance network info cache for port 30e4879f-dced-4de7-92f5-251b88dc5a8c. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG nova.network.neutron [req-509f9ae4-adf7-4b53-8611-2ea03a3d0502 req-7da72377-e3c2-4f4f-86ed-c1d219d3508c service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Updating instance_info_cache with network_info: [{"id": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "address": "fa:16:3e:f1:41:1a", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30e4879f-dc", "ovs_interfaceid": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:03:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-509f9ae4-adf7-4b53-8611-2ea03a3d0502 req-7da72377-e3c2-4f4f-86ed-c1d219d3508c service nova] Releasing lock "refresh_cache-5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG nova.network.neutron [req-352bae7b-ebc8-4336-9edf-349b897ca8a6 req-00409551-7456-46af-ac77-8dd768fc967f service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updated VIF entry in instance network info cache for port 02ca6838-89e2-41bc-a858-dc7a007f7960. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG nova.network.neutron [req-352bae7b-ebc8-4336-9edf-349b897ca8a6 req-00409551-7456-46af-ac77-8dd768fc967f service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updating instance_info_cache with network_info: [{"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-352bae7b-ebc8-4336-9edf-349b897ca8a6 req-00409551-7456-46af-ac77-8dd768fc967f service nova] Releasing lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:03:21 user nova-compute[70645]: WARNING nova.compute.manager [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received unexpected event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:03:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:03:21 user nova-compute[70645]: WARNING nova.compute.manager [req-dab04c1d-f1b9-45c0-8b67-3299e6f39d9b req-e2cadecb-e6d7-45cd-a1b6-5cf98549d287 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received unexpected event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:03:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-e96134c6-09d3-418a-86f5-07c8c3c044d8 req-4f36f214-24b2-410b-b2ad-6951827da0ec service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-changed-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-e96134c6-09d3-418a-86f5-07c8c3c044d8 req-4f36f214-24b2-410b-b2ad-6951827da0ec service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Refreshing instance network info cache due to event network-changed-02ca6838-89e2-41bc-a858-dc7a007f7960. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:03:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e96134c6-09d3-418a-86f5-07c8c3c044d8 req-4f36f214-24b2-410b-b2ad-6951827da0ec service nova] Acquiring lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:03:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e96134c6-09d3-418a-86f5-07c8c3c044d8 req-4f36f214-24b2-410b-b2ad-6951827da0ec service nova] Acquired lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:03:22 user nova-compute[70645]: DEBUG nova.network.neutron [req-e96134c6-09d3-418a-86f5-07c8c3c044d8 req-4f36f214-24b2-410b-b2ad-6951827da0ec service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Refreshing network info cache for port 02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:03:23 user nova-compute[70645]: DEBUG nova.network.neutron [req-e96134c6-09d3-418a-86f5-07c8c3c044d8 req-4f36f214-24b2-410b-b2ad-6951827da0ec service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updated VIF entry in instance network info cache for port 02ca6838-89e2-41bc-a858-dc7a007f7960. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:03:23 user nova-compute[70645]: DEBUG nova.network.neutron [req-e96134c6-09d3-418a-86f5-07c8c3c044d8 req-4f36f214-24b2-410b-b2ad-6951827da0ec service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updating instance_info_cache with network_info: [{"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:03:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e96134c6-09d3-418a-86f5-07c8c3c044d8 req-4f36f214-24b2-410b-b2ad-6951827da0ec service nova] Releasing lock "refresh_cache-6fafa215-3ee5-4efb-816a-1d9f72e667da" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG nova.compute.manager [req-6c6b9656-3045-4c82-b6a3-549ceeb9bdad req-47c478aa-151a-4c16-a5c3-e552f052e93d service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6c6b9656-3045-4c82-b6a3-549ceeb9bdad req-47c478aa-151a-4c16-a5c3-e552f052e93d service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6c6b9656-3045-4c82-b6a3-549ceeb9bdad req-47c478aa-151a-4c16-a5c3-e552f052e93d service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6c6b9656-3045-4c82-b6a3-549ceeb9bdad req-47c478aa-151a-4c16-a5c3-e552f052e93d service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG nova.compute.manager [req-6c6b9656-3045-4c82-b6a3-549ceeb9bdad req-47c478aa-151a-4c16-a5c3-e552f052e93d service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:03:24 user nova-compute[70645]: WARNING nova.compute.manager [req-6c6b9656-3045-4c82-b6a3-549ceeb9bdad req-47c478aa-151a-4c16-a5c3-e552f052e93d service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received unexpected event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:03:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 6fafa215-3ee5-4efb-816a-1d9f72e667da due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211004.3099113, 6fafa215-3ee5-4efb-816a-1d9f72e667da => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:03:24 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] VM Resumed (Lifecycle Event)
Jul 24 15:03:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7ddb62a7-1497-470b-a311-9b1461525cce tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:03:24 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 15:03:24 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211004.3115633, 6fafa215-3ee5-4efb-816a-1d9f72e667da => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:03:24 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] VM Started (Lifecycle Event)
Jul 24 15:03:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:03:24 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 15:03:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:03:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvTwHQog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:03:27 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:03:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:03:27 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:03:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:03:27 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffe965e-5e1c-42c1-b7f0-95d4bd05fc3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:03:27 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99c371b-aed7-4652-96a8-1d38b811d5cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40] added
Jul 24 15:03:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6fa565-59d1-4e92-938a-25d66951a306]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9035deab-eadd-4f9b-8d0a-71235e35c64e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BvTwHQog {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BvTwHQog" returned: 0 in 0.030s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e9a674-18a0-400c-85ef-62da06aa2f6c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BvTwHQog'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ca0a07-0c6f-4a74-a223-ad7e2f32c174]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6b5557-d2a1-4f5f-9d70-19bb11fa21ce]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1b7c39-eec9-4f75-b3ea-57f8e7aac8d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40, portal: 172.16.0.220,3260]
Jul 24 15:03:28 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40, portal: 172.16.0.220,3260] successful.
Jul 24 15:03:28 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e28fd0-59d6-4442-a3ca-d7183dec3ae2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fcfa42-e51e-4536-b3eb-7bdd2d6e4f36]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 (non-flash)
Jul 24 15:03:28 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[43049e84-5b57-44eb-ac0c-4531167dd448]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:29 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:03:29 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7393MB free_disk=24.241676330566406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvTwHQog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23763343930373232', 'path': '/dev/sdd'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763343930373232', 'path': '/dev/sdd'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'flavor' on Instance uuid 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:03:29 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:03:29 user nova-compute[70645]:   <source dev="/dev/sdd"/>
Jul 24 15:03:29 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:03:29 user nova-compute[70645]:   <serial>f1f7df33-6394-4176-9086-94015c10ef40</serial>
Jul 24 15:03:29 user nova-compute[70645]: </disk>
Jul 24 15:03:29 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 6fafa215-3ee5-4efb-816a-1d9f72e667da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 734abf9a-96dd-40b4-9b68-2d42fa079216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 460ae655-2955-4a45-9b12-2a3ddd9f448b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 07adce07-b416-44fb-b548-17b8cd0d8168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 9ea99927-77d9-4e98-b435-d4c781031d90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] No VIF found with MAC fa:16:3e:f1:41:1a, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] There are 0 instances to clean {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70645) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c7abe73-1dd9-47e2-8fd2-ad48982e2793 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.869s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:03:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:03:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:03:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:03:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Updating instance_info_cache with network_info: [{"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:03:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:03:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:03:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:03:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:03:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:03:47 user nova-compute[70645]: INFO nova.compute.claims [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Claim successful on node user
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.network.neutron [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:03:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.policy [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2693e2ea7d864b39b59e96156aa9ca3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aea075d521479db680d0553e30f0a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:03:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Creating image(s)
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "/opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "/opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk 1073741824" returned: 0 in 0.061s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.152s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Cannot resize image /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.objects.instance [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lazy-loading 'migration_context' on Instance uuid 8ad33774-2d1b-480d-871d-f422c941c806 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:03:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Ensure instance console log exists: /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG nova.network.neutron [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Successfully created port: b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG nova.network.neutron [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Successfully updated port: b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "refresh_cache-8ad33774-2d1b-480d-871d-f422c941c806" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquired lock "refresh_cache-8ad33774-2d1b-480d-871d-f422c941c806" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG nova.network.neutron [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-c035fc89-f815-4b54-95e2-20ec7dc0ab21 req-a504b279-7c90-491d-bdda-69247ab42e6a service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Received event network-changed-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-c035fc89-f815-4b54-95e2-20ec7dc0ab21 req-a504b279-7c90-491d-bdda-69247ab42e6a service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Refreshing instance network info cache due to event network-changed-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c035fc89-f815-4b54-95e2-20ec7dc0ab21 req-a504b279-7c90-491d-bdda-69247ab42e6a service nova] Acquiring lock "refresh_cache-8ad33774-2d1b-480d-871d-f422c941c806" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:03:49 user nova-compute[70645]: DEBUG nova.network.neutron [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.network.neutron [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Updating instance_info_cache with network_info: [{"id": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "address": "fa:16:3e:e3:de:db", "network": {"id": "c10d23da-ee3b-45ad-b6d7-cbee6fe26734", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2122699067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aea075d521479db680d0553e30f0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65f6c0a-8a", "ovs_interfaceid": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Releasing lock "refresh_cache-8ad33774-2d1b-480d-871d-f422c941c806" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Instance network_info: |[{"id": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "address": "fa:16:3e:e3:de:db", "network": {"id": "c10d23da-ee3b-45ad-b6d7-cbee6fe26734", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2122699067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aea075d521479db680d0553e30f0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65f6c0a-8a", "ovs_interfaceid": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c035fc89-f815-4b54-95e2-20ec7dc0ab21 req-a504b279-7c90-491d-bdda-69247ab42e6a service nova] Acquired lock "refresh_cache-8ad33774-2d1b-480d-871d-f422c941c806" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-c035fc89-f815-4b54-95e2-20ec7dc0ab21 req-a504b279-7c90-491d-bdda-69247ab42e6a service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Refreshing network info cache for port b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Start _get_guest_xml network_info=[{"id": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "address": "fa:16:3e:e3:de:db", "network": {"id": "c10d23da-ee3b-45ad-b6d7-cbee6fe26734", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2122699067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aea075d521479db680d0553e30f0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65f6c0a-8a", "ovs_interfaceid": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:03:50 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:03:50 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1650598652',display_name='tempest-TestServerVolumeAttachmentScenario-server-1650598652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1650598652',id=26,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWgRd3GwZFX0rTua2lxmm6v0b7YJZWOQPOediwnal7za7tlbKkuF39FOtaqxEUgiXHP+l6kQhiIYQr05RCTC5VF+jcqJNJ/J0g+nQDB9u0K0qQcIen0PVcZkMao+M5bqg==',key_name='tempest-keypair-798610159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aea075d521479db680d0553e30f0a0',ramdisk_id='',reservation_id='r-fvkbwygu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1433307753',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1433307753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2693e2ea7d864b39b59e96156aa9ca3b',uuid=8ad33774-2d1b-480d-871d-f422c941c806,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "address": "fa:16:3e:e3:de:db", "network": {"id": "c10d23da-ee3b-45ad-b6d7-cbee6fe26734", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2122699067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aea075d521479db680d0553e30f0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65f6c0a-8a", "ovs_interfaceid": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Converting VIF {"id": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "address": "fa:16:3e:e3:de:db", "network": {"id": "c10d23da-ee3b-45ad-b6d7-cbee6fe26734", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2122699067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aea075d521479db680d0553e30f0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65f6c0a-8a", "ovs_interfaceid": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:de:db,bridge_name='br-int',has_traffic_filtering=True,id=b65f6c0a-8af9-451a-a64b-bfc1f9b4a504,network=Network(c10d23da-ee3b-45ad-b6d7-cbee6fe26734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65f6c0a-8a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.objects.instance [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ad33774-2d1b-480d-871d-f422c941c806 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:03:50 user nova-compute[70645]:   <uuid>8ad33774-2d1b-480d-871d-f422c941c806</uuid>
Jul 24 15:03:50 user nova-compute[70645]:   <name>instance-0000001a</name>
Jul 24 15:03:50 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:03:50 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:03:50 user nova-compute[70645]:   <metadata>
Jul 24 15:03:50 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:03:50 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:03:50 user nova-compute[70645]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1650598652</nova:name>
Jul 24 15:03:50 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:03:50</nova:creationTime>
Jul 24 15:03:50 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:03:50 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:03:50 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:03:50 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:03:50 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:03:50 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:03:50 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:03:50 user nova-compute[70645]:       <nova:owner>
Jul 24 15:03:50 user nova-compute[70645]:         <nova:user uuid="2693e2ea7d864b39b59e96156aa9ca3b">tempest-TestServerVolumeAttachmentScenario-1433307753-project-member</nova:user>
Jul 24 15:03:50 user nova-compute[70645]:         <nova:project uuid="08aea075d521479db680d0553e30f0a0">tempest-TestServerVolumeAttachmentScenario-1433307753</nova:project>
Jul 24 15:03:50 user nova-compute[70645]:       </nova:owner>
Jul 24 15:03:50 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:03:50 user nova-compute[70645]:       <nova:ports>
Jul 24 15:03:50 user nova-compute[70645]:         <nova:port uuid="b65f6c0a-8af9-451a-a64b-bfc1f9b4a504">
Jul 24 15:03:50 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 15:03:50 user nova-compute[70645]:         </nova:port>
Jul 24 15:03:50 user nova-compute[70645]:       </nova:ports>
Jul 24 15:03:50 user nova-compute[70645]:     </nova:instance>
Jul 24 15:03:50 user nova-compute[70645]:   </metadata>
Jul 24 15:03:50 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:03:50 user nova-compute[70645]:     <system>
Jul 24 15:03:50 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:03:50 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:03:50 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:03:50 user nova-compute[70645]:       <entry name="serial">8ad33774-2d1b-480d-871d-f422c941c806</entry>
Jul 24 15:03:50 user nova-compute[70645]:       <entry name="uuid">8ad33774-2d1b-480d-871d-f422c941c806</entry>
Jul 24 15:03:50 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:03:50 user nova-compute[70645]:     </system>
Jul 24 15:03:50 user nova-compute[70645]:   </sysinfo>
Jul 24 15:03:50 user nova-compute[70645]:   <os>
Jul 24 15:03:50 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:03:50 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:03:50 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:03:50 user nova-compute[70645]:   </os>
Jul 24 15:03:50 user nova-compute[70645]:   <features>
Jul 24 15:03:50 user nova-compute[70645]:     <acpi/>
Jul 24 15:03:50 user nova-compute[70645]:     <apic/>
Jul 24 15:03:50 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:03:50 user nova-compute[70645]:   </features>
Jul 24 15:03:50 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:03:50 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:03:50 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:03:50 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:03:50 user nova-compute[70645]:   </clock>
Jul 24 15:03:50 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:03:50 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:03:50 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:03:50 user nova-compute[70645]:   </cpu>
Jul 24 15:03:50 user nova-compute[70645]:   <devices>
Jul 24 15:03:50 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:03:50 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:03:50 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk"/>
Jul 24 15:03:50 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:03:50 user nova-compute[70645]:     </disk>
Jul 24 15:03:50 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:03:50 user nova-compute[70645]:       <mac address="fa:16:3e:e3:de:db"/>
Jul 24 15:03:50 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:03:50 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:03:50 user nova-compute[70645]:       <target dev="tapb65f6c0a-8a"/>
Jul 24 15:03:50 user nova-compute[70645]:     </interface>
Jul 24 15:03:50 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:03:50 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/console.log" append="off"/>
Jul 24 15:03:50 user nova-compute[70645]:     </serial>
Jul 24 15:03:50 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:03:50 user nova-compute[70645]:     <video>
Jul 24 15:03:50 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:03:50 user nova-compute[70645]:     </video>
Jul 24 15:03:50 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:03:50 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:03:50 user nova-compute[70645]:     </rng>
Jul 24 15:03:50 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:03:50 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:03:50 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:03:50 user nova-compute[70645]:     </memballoon>
Jul 24 15:03:50 user nova-compute[70645]:   </devices>
Jul 24 15:03:50 user nova-compute[70645]: </domain>
Jul 24 15:03:50 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1650598652',display_name='tempest-TestServerVolumeAttachmentScenario-server-1650598652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1650598652',id=26,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWgRd3GwZFX0rTua2lxmm6v0b7YJZWOQPOediwnal7za7tlbKkuF39FOtaqxEUgiXHP+l6kQhiIYQr05RCTC5VF+jcqJNJ/J0g+nQDB9u0K0qQcIen0PVcZkMao+M5bqg==',key_name='tempest-keypair-798610159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aea075d521479db680d0553e30f0a0',ramdisk_id='',reservation_id='r-fvkbwygu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1433307753',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1433307753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2693e2ea7d864b39b59e96156aa9ca3b',uuid=8ad33774-2d1b-480d-871d-f422c941c806,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "address": "fa:16:3e:e3:de:db", "network": {"id": "c10d23da-ee3b-45ad-b6d7-cbee6fe26734", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2122699067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aea075d521479db680d0553e30f0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65f6c0a-8a", "ovs_interfaceid": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Converting VIF {"id": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "address": "fa:16:3e:e3:de:db", "network": {"id": "c10d23da-ee3b-45ad-b6d7-cbee6fe26734", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2122699067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aea075d521479db680d0553e30f0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65f6c0a-8a", "ovs_interfaceid": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:de:db,bridge_name='br-int',has_traffic_filtering=True,id=b65f6c0a-8af9-451a-a64b-bfc1f9b4a504,network=Network(c10d23da-ee3b-45ad-b6d7-cbee6fe26734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65f6c0a-8a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG os_vif [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:de:db,bridge_name='br-int',has_traffic_filtering=True,id=b65f6c0a-8af9-451a-a64b-bfc1f9b4a504,network=Network(c10d23da-ee3b-45ad-b6d7-cbee6fe26734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65f6c0a-8a') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb65f6c0a-8a, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb65f6c0a-8a, col_values=(('external_ids', {'iface-id': 'b65f6c0a-8af9-451a-a64b-bfc1f9b4a504', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:de:db', 'vm-uuid': '8ad33774-2d1b-480d-871d-f422c941c806'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:50 user nova-compute[70645]: INFO os_vif [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:de:db,bridge_name='br-int',has_traffic_filtering=True,id=b65f6c0a-8af9-451a-a64b-bfc1f9b4a504,network=Network(c10d23da-ee3b-45ad-b6d7-cbee6fe26734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65f6c0a-8a')
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] No VIF found with MAC fa:16:3e:e3:de:db, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:50 user nova-compute[70645]: INFO nova.compute.manager [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Detaching volume f1f7df33-6394-4176-9086-94015c10ef40
Jul 24 15:03:50 user nova-compute[70645]: INFO nova.virt.block_device [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Attempting to driver detach volume f1f7df33-6394-4176-9086-94015c10ef40 from mountpoint /dev/vdb
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Attempting to detach device vdb from instance 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:03:50 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:03:50 user nova-compute[70645]:   <source dev="/dev/sdd"/>
Jul 24 15:03:50 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:03:50 user nova-compute[70645]:   <serial>f1f7df33-6394-4176-9086-94015c10ef40</serial>
Jul 24 15:03:50 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:03:50 user nova-compute[70645]: </disk>
Jul 24 15:03:50 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:50 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Successfully detached device vdb from instance 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 from the persistent domain config.
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:03:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:03:50 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:03:50 user nova-compute[70645]:   <source dev="/dev/sdd"/>
Jul 24 15:03:50 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:03:50 user nova-compute[70645]:   <serial>f1f7df33-6394-4176-9086-94015c10ef40</serial>
Jul 24 15:03:50 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:03:50 user nova-compute[70645]: </disk>
Jul 24 15:03:50 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG nova.network.neutron [req-c035fc89-f815-4b54-95e2-20ec7dc0ab21 req-a504b279-7c90-491d-bdda-69247ab42e6a service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Updated VIF entry in instance network info cache for port b65f6c0a-8af9-451a-a64b-bfc1f9b4a504. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG nova.network.neutron [req-c035fc89-f815-4b54-95e2-20ec7dc0ab21 req-a504b279-7c90-491d-bdda-69247ab42e6a service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Updating instance_info_cache with network_info: [{"id": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "address": "fa:16:3e:e3:de:db", "network": {"id": "c10d23da-ee3b-45ad-b6d7-cbee6fe26734", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2122699067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aea075d521479db680d0553e30f0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65f6c0a-8a", "ovs_interfaceid": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c035fc89-f815-4b54-95e2-20ec7dc0ab21 req-a504b279-7c90-491d-bdda-69247ab42e6a service nova] Releasing lock "refresh_cache-8ad33774-2d1b-480d-871d-f422c941c806" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211031.445503, 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:03:51 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Successfully detached device vdb from instance 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 from the live domain config.
Jul 24 15:03:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvTwHQog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:03:51 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4c31c0-565a-4b31-bfec-23d98ca0cc24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5fe611-185f-465c-9f53-99f04376d7c4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 (non-flash)
Jul 24 15:03:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba84295c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40'): ({'sdd'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Removing single pathed devices sdd {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cc84ba-0600-4a3c-939d-171b3095b928]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e54531f-c877-4a60-92e4-bced74907599]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Flushing IO for device /dev/sdd {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:03:51 user nova-compute[70645]: INFO nova.compute.claims [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Claim successful on node user
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd0e513-5a7b-452a-9686-64b4847a6e7e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7941fc-7e2f-4583-9035-97f4f5a4f372]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6765a0eb-d821-4aaa-b937-27be080c2420]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b78c370-5414-4960-8df7-be6a2129dc57]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40, portal: 172.16.0.220,3260]
Jul 24 15:03:51 user nova-compute[70645]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40, portal: 172.16.0.220,3260] successful.
Jul 24 15:03:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61dff64-7557-42fa-b926-a7130b672ec4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] <== disconnect_volume: return (310ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:03:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:52 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.policy [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '192b7bd8dd234dceadc22ba7bb092344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab8baa391424072ba5bcea7f54f0242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:03:52 user nova-compute[70645]: INFO nova.virt.block_device [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Booting with volume-backed-image b4bccd44-68c1-4fe3-8a56-c3963153c7de at /dev/vda
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-96ae4e25-a5a1-47be-a59f-b4cece91a5d7 req-cd59a1c2-e84c-4eb2-86d7-90a5bbc9ee4b service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Received event network-vif-plugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-96ae4e25-a5a1-47be-a59f-b4cece91a5d7 req-cd59a1c2-e84c-4eb2-86d7-90a5bbc9ee4b service nova] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-96ae4e25-a5a1-47be-a59f-b4cece91a5d7 req-cd59a1c2-e84c-4eb2-86d7-90a5bbc9ee4b service nova] Lock "8ad33774-2d1b-480d-871d-f422c941c806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-96ae4e25-a5a1-47be-a59f-b4cece91a5d7 req-cd59a1c2-e84c-4eb2-86d7-90a5bbc9ee4b service nova] Lock "8ad33774-2d1b-480d-871d-f422c941c806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-96ae4e25-a5a1-47be-a59f-b4cece91a5d7 req-cd59a1c2-e84c-4eb2-86d7-90a5bbc9ee4b service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] No waiting events found dispatching network-vif-plugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:03:52 user nova-compute[70645]: WARNING nova.compute.manager [req-96ae4e25-a5a1-47be-a59f-b4cece91a5d7 req-cd59a1c2-e84c-4eb2-86d7-90a5bbc9ee4b service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Received unexpected event network-vif-plugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 for instance with vm_state building and task_state spawning.
Jul 24 15:03:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:52 user nova-compute[70645]: INFO nova.compute.manager [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Detaching volume 4222d72b-3e4f-4712-87d6-dab4d4cbc758
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.objects.instance [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'flavor' on Instance uuid 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:03:52 user nova-compute[70645]: INFO nova.virt.block_device [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Attempting to driver detach volume 4222d72b-3e4f-4712-87d6-dab4d4cbc758 from mountpoint /dev/vdb
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Attempting to detach device vdb from instance 6fafa215-3ee5-4efb-816a-1d9f72e667da from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:03:52 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:03:52 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:03:52 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:03:52 user nova-compute[70645]:   <serial>4222d72b-3e4f-4712-87d6-dab4d4cbc758</serial>
Jul 24 15:03:52 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:03:52 user nova-compute[70645]: </disk>
Jul 24 15:03:52 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:03:52 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Successfully detached device vdb from instance 6fafa215-3ee5-4efb-816a-1d9f72e667da from the persistent domain config.
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fafa215-3ee5-4efb-816a-1d9f72e667da from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:03:52 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:03:52 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:03:52 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:03:52 user nova-compute[70645]:   <serial>4222d72b-3e4f-4712-87d6-dab4d4cbc758</serial>
Jul 24 15:03:52 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:03:52 user nova-compute[70645]: </disk>
Jul 24 15:03:52 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ce94554-6f0a-4e5a-8a33-82734035eafe tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.964s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.853s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:52 user nova-compute[70645]: INFO nova.compute.manager [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Terminating instance
Jul 24 15:03:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Successfully created port: fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211033.1662724, 6fafa215-3ee5-4efb-816a-1d9f72e667da => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:03:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Successfully detached device vdb from instance 6fafa215-3ee5-4efb-816a-1d9f72e667da from the live domain config.
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypdXhQnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:03:53 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69a19d2-f0cd-4b59-90eb-14e6cbe6f0f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d91d27-a395-443a-81ac-755148b1f575]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba842bc9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758'): ({'sde'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Removing single pathed devices sde {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[330ab407-e43d-4429-9f43-02feea454538]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2f76e9-d6a5-4ba6-b1a7-75150f563e35]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Flushing IO for device /dev/sde {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4ffba5-3902-43d0-b46d-0edc7e991f45]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c75f4-55bd-4df2-a9f7-c3553e7f03ce]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] SCSI volumes sde have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b00b00-b886-4250-ad15-b2ba4b296e13]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ec625b-9740-4e63-a4de-df028dff9194]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758, portal: 172.16.0.220,3260]
Jul 24 15:03:53 user nova-compute[70645]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758, portal: 172.16.0.220,3260] successful.
Jul 24 15:03:53 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d72b-3e4f-4712-87d6-dab4d4cbc758 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7aec55-5712-465c-b26c-18c6c2277575]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] <== disconnect_volume: return (356ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:03:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Instance destroyed successfully.
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.objects.instance [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'resources' on Instance uuid 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-13420737',display_name='tempest-VolumesSnapshotTestJSON-instance-13420737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-13420737',id=25,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADUTyqkK4wtlzDXr2TnBZaDT1YCMHmG8Cd5k6DeSDD74pppraUSyNbHW3G1corvEzB2MLRhpynn9fEA+OgwcNG4UcDU1Y1iEYTiMNEgzViS6EMuePJewnweJlzQKFOMoQ==',key_name='tempest-keypair-1084911921',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:01:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f2edf2107c94e1195d57905b59344fb',ramdisk_id='',reservation_id='r-xnv4ezsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1862271743',owner_user_name='tempest-VolumesSnapshotTestJSON-1862271743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:01:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cfc37f67c214e638adb1409d4db18d6',uuid=5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "address": "fa:16:3e:f1:41:1a", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30e4879f-dc", "ovs_interfaceid": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converting VIF {"id": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "address": "fa:16:3e:f1:41:1a", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30e4879f-dc", "ovs_interfaceid": "30e4879f-dced-4de7-92f5-251b88dc5a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:41:1a,bridge_name='br-int',has_traffic_filtering=True,id=30e4879f-dced-4de7-92f5-251b88dc5a8c,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30e4879f-dc') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_vif [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:41:1a,bridge_name='br-int',has_traffic_filtering=True,id=30e4879f-dced-4de7-92f5-251b88dc5a8c,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30e4879f-dc') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30e4879f-dc, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:03:53 user nova-compute[70645]: INFO os_vif [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:41:1a,bridge_name='br-int',has_traffic_filtering=True,id=30e4879f-dced-4de7-92f5-251b88dc5a8c,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30e4879f-dc')
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvTwHQog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:03:53 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f7df33-6394-4176-9086-94015c10ef40', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c143c9-bb1d-4929-a14c-3102621130be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[325b0c1a-6a97-4ec1-9f6e-7e5c009e2946]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:53 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba941a5870>, {}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Disconnecting from: [] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.057s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] <== disconnect_volume: return (60ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:03:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Deleting instance files /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9_del
Jul 24 15:03:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Deletion of /opt/stack/data/nova/instances/5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9_del complete
Jul 24 15:03:53 user nova-compute[70645]: INFO nova.compute.manager [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Took 1.03 seconds to destroy the instance on the hypervisor.
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Successfully updated port: fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquired lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-0e626a1c-1575-4b42-b6f9-2d551e16b05a req-742ec5ec-6b76-4f66-a864-c2bc4a0893c9 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-changed-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-0e626a1c-1575-4b42-b6f9-2d551e16b05a req-742ec5ec-6b76-4f66-a864-c2bc4a0893c9 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Refreshing instance network info cache due to event network-changed-fb210eeb-c5aa-4c30-988b-772930ecc039. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0e626a1c-1575-4b42-b6f9-2d551e16b05a req-742ec5ec-6b76-4f66-a864-c2bc4a0893c9 service nova] Acquiring lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:03:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Updating instance_info_cache with network_info: [{"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Releasing lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Instance network_info: |[{"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0e626a1c-1575-4b42-b6f9-2d551e16b05a req-742ec5ec-6b76-4f66-a864-c2bc4a0893c9 service nova] Acquired lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.network.neutron [req-0e626a1c-1575-4b42-b6f9-2d551e16b05a req-742ec5ec-6b76-4f66-a864-c2bc4a0893c9 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Refreshing network info cache for port fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.objects.instance [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'flavor' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Received event network-vif-plugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] Lock "8ad33774-2d1b-480d-871d-f422c941c806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] Lock "8ad33774-2d1b-480d-871d-f422c941c806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] No waiting events found dispatching network-vif-plugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:03:54 user nova-compute[70645]: WARNING nova.compute.manager [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Received unexpected event network-vif-plugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 for instance with vm_state building and task_state spawning.
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Received event network-vif-unplugged-30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] Acquiring lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] No waiting events found dispatching network-vif-unplugged-30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Received event network-vif-unplugged-30e4879f-dced-4de7-92f5-251b88dc5a8c for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Received event network-vif-plugged-30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] Acquiring lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] No waiting events found dispatching network-vif-plugged-30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:03:54 user nova-compute[70645]: WARNING nova.compute.manager [req-8eed1305-4f16-4fdc-8436-0b586fe576f2 req-d8d20b92-f541-4013-a6a1-b3fa51a70b28 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Received unexpected event network-vif-plugged-30e4879f-dced-4de7-92f5-251b88dc5a8c for instance with vm_state active and task_state deleting.
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-53829b3e-a01c-4182-98bf-f355f293b6bb tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.959s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211034.5278866, 8ad33774-2d1b-480d-871d-f422c941c806 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:03:54 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] VM Resumed (Lifecycle Event)
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:03:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Instance spawned successfully.
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:03:54 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211034.528149, 8ad33774-2d1b-480d-871d-f422c941c806 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:03:54 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] VM Started (Lifecycle Event)
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-1baf9ff6-7050-4dee-b293-79e2594d0b4e req-c31d0fae-51ee-499f-b18c-8d8516892c63 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Received event network-vif-deleted-30e4879f-dced-4de7-92f5-251b88dc5a8c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:03:54 user nova-compute[70645]: INFO nova.compute.manager [req-1baf9ff6-7050-4dee-b293-79e2594d0b4e req-c31d0fae-51ee-499f-b18c-8d8516892c63 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Neutron deleted interface 30e4879f-dced-4de7-92f5-251b88dc5a8c; detaching it from the instance and deleting it from the info cache
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.network.neutron [req-1baf9ff6-7050-4dee-b293-79e2594d0b4e req-c31d0fae-51ee-499f-b18c-8d8516892c63 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:03:54 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-1baf9ff6-7050-4dee-b293-79e2594d0b4e req-c31d0fae-51ee-499f-b18c-8d8516892c63 service nova] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Detach interface failed, port_id=30e4879f-dced-4de7-92f5-251b88dc5a8c, reason: Instance 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:03:54 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Took 1.01 seconds to deallocate network for instance.
Jul 24 15:03:54 user nova-compute[70645]: INFO nova.compute.manager [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Took 6.53 seconds to spawn the instance on the hypervisor.
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:03:54 user nova-compute[70645]: WARNING nova.volume.cinder [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Attachment c5503cc6-46f4-44e7-a5c8-093c6e1a8e63 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c5503cc6-46f4-44e7-a5c8-093c6e1a8e63. (HTTP 404) (Request-ID: req-a40dbf3a-54dd-4e17-80a4-66e3b3554b75)
Jul 24 15:03:54 user nova-compute[70645]: INFO nova.compute.manager [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Took 0.04 seconds to detach 1 volumes for instance.
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.network.neutron [req-0e626a1c-1575-4b42-b6f9-2d551e16b05a req-742ec5ec-6b76-4f66-a864-c2bc4a0893c9 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Updated VIF entry in instance network info cache for port fb210eeb-c5aa-4c30-988b-772930ecc039. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG nova.network.neutron [req-0e626a1c-1575-4b42-b6f9-2d551e16b05a req-742ec5ec-6b76-4f66-a864-c2bc4a0893c9 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Updating instance_info_cache with network_info: [{"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0e626a1c-1575-4b42-b6f9-2d551e16b05a req-742ec5ec-6b76-4f66-a864-c2bc4a0893c9 service nova] Releasing lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:54 user nova-compute[70645]: INFO nova.compute.manager [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Took 7.29 seconds to build instance.
Jul 24 15:03:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-854d8d06-758d-43fc-b3e6-9de033127cb5 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.434s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:03:55 user nova-compute[70645]: INFO nova.compute.manager [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Detaching volume e3f27e19-7b39-459d-845b-bc45924f64d2
Jul 24 15:03:55 user nova-compute[70645]: INFO nova.virt.block_device [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Attempting to driver detach volume e3f27e19-7b39-459d-845b-bc45924f64d2 from mountpoint /dev/vdc
Jul 24 15:03:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Attempting to detach device vdc from instance 9ea99927-77d9-4e98-b435-d4c781031d90 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:03:55 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:03:55 user nova-compute[70645]:   <source dev="/dev/sdf"/>
Jul 24 15:03:55 user nova-compute[70645]:   <target dev="vdc" bus="virtio"/>
Jul 24 15:03:55 user nova-compute[70645]:   <serial>e3f27e19-7b39-459d-845b-bc45924f64d2</serial>
Jul 24 15:03:55 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 15:03:55 user nova-compute[70645]: </disk>
Jul 24 15:03:55 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:03:55 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Successfully detached device vdc from instance 9ea99927-77d9-4e98-b435-d4c781031d90 from the persistent domain config.
Jul 24 15:03:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9ea99927-77d9-4e98-b435-d4c781031d90 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:03:55 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:03:55 user nova-compute[70645]:   <source dev="/dev/sdf"/>
Jul 24 15:03:55 user nova-compute[70645]:   <target dev="vdc" bus="virtio"/>
Jul 24 15:03:55 user nova-compute[70645]:   <serial>e3f27e19-7b39-459d-845b-bc45924f64d2</serial>
Jul 24 15:03:55 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 15:03:55 user nova-compute[70645]: </disk>
Jul 24 15:03:55 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.551s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:55 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Deleted allocations for instance 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-951f822f-b35b-48f4-a3fc-705654dde884 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.836s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211035.6889293, 9ea99927-77d9-4e98-b435-d4c781031d90 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:03:55 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Successfully detached device vdc from instance 9ea99927-77d9-4e98-b435-d4c781031d90 from the live domain config.
Jul 24 15:03:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqHOLcKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:03:55 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca34245e-49e3-4f1a-b73c-d490b9b9af56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f8ae8c-8394-4c1d-822e-609b0329ed77]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:55 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:55 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:55 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:55 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:03:55 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:03:55 user nova-compute[70645]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 (non-flash)
Jul 24 15:03:55 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:03:55 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba842be4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2'): ({'sdf'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Removing single pathed devices sdf {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c988bf25-0526-45be-81a5-cda99e53f98f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a906656-8be9-4ff0-8a24-347c95c8eae8]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Flushing IO for device /dev/sdf {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aac7d2-4cf7-438e-b1fd-1d6f0ffda1bd]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[843dfc0e-b533-4f19-bf09-d43f17bc3978]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] SCSI volumes sdf have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bab4662-740f-4b1a-9acc-1eedfd72e173]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b58e6c-0b85-44a8-8a19-47d51e77f7a4]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2, portal: 172.16.0.220,3260]
Jul 24 15:03:55 user nova-compute[70645]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2, portal: 172.16.0.220,3260] successful.
Jul 24 15:03:55 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f27e19-7b39-459d-845b-bc45924f64d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:56 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3de649-4832-4dec-a53c-49627068cf10]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:56 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:03:56 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:03:56 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] <== disconnect_volume: return (310ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:03:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:03:56 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'flavor' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:03:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4ab905a5-41f8-46f7-b867-6acf286492b4 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:03:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG os_brick.utils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[85790764-a481-4a04-88f0-aab3db625f0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b97bb6e-6358-4427-9529-a78f725bf8df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[923b3f07-3818-4a02-b21a-06476b7c8b79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[667c4113-66eb-49f9-b8b6-85d300afb2de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:03:58 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:03:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d595e706-1bbe-4f08-b185-1035847c6479]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG os_brick.utils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Updating existing volume attachment record: d568764d-5fb0-40c8-8520-0057d0bb050a {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:03:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:04:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:04:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:04:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:04:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:04:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Creating image(s)
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Ensure instance console log exists: /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Start _get_guest_xml network_info=[{"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd568764d-5fb0-40c8-8520-0057d0bb050a', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmqZWKIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f686b79-b22d-4453-ae35-7a1133d7aa86', 'attached_at': '', 'detached_at': '', 'volume_id': '96ff20c5-6dd6-430e-9a18-81c906547b37', 'serial': '96ff20c5-6dd6-430e-9a18-81c906547b37'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:04:05 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:04:05 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmqZWKIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:04:05 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:04:05 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:04:05 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8965e72d-1898-490e-9483-ec4bbdc956b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:04:05 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7ab072-2295-432f-84ad-dbccb311bc47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37] added
Jul 24 15:04:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[196ae065-b92e-4913-adc5-def142b49150]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d191ea-c88f-4ea7-8bc8-d1c30fcd5c0b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmqZWKIH {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmqZWKIH" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8235969-77d8-46a1-8d04-ce502b53cbde]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmqZWKIH'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.092s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b85cbe-c118-45a7-a2c8-bce202511762]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[651005af-5831-4f7b-9694-85629c8f58a6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74c28c2-c2aa-4437-b2cd-05bc0d5fa9a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37, portal: 172.16.0.220,3260]
Jul 24 15:04:05 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37, portal: 172.16.0.220,3260] successful.
Jul 24 15:04:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.220s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[419ea89b-6346-4d0e-972c-8c5812478a9b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca101c-12f4-4fab-b511-d4049feae7a1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:04:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.564s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a36f86-650a-42e7-b798-2b33b5f887fd]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:04:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmqZWKIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.594s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] <== connect_volume: return (1595ms) {'type': 'block', 'scsi_wwn': '23733623064333766', 'path': '/dev/sdd'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733623064333766', 'path': '/dev/sdd'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1406665233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1406665233',id=27,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-ttaam4dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:03:52Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=4f686b79-b22d-4453-ae35-7a1133d7aa86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a1:8d,bridge_name='br-int',has_traffic_filtering=True,id=fb210eeb-c5aa-4c30-988b-772930ecc039,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb210eeb-c5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f686b79-b22d-4453-ae35-7a1133d7aa86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:04:06 user nova-compute[70645]:   <uuid>4f686b79-b22d-4453-ae35-7a1133d7aa86</uuid>
Jul 24 15:04:06 user nova-compute[70645]:   <name>instance-0000001b</name>
Jul 24 15:04:06 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:04:06 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:04:06 user nova-compute[70645]:   <metadata>
Jul 24 15:04:06 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:04:06 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:04:06 user nova-compute[70645]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1406665233</nova:name>
Jul 24 15:04:06 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:04:05</nova:creationTime>
Jul 24 15:04:06 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:04:06 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:04:06 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:04:06 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:04:06 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:04:06 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:04:06 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:04:06 user nova-compute[70645]:       <nova:owner>
Jul 24 15:04:06 user nova-compute[70645]:         <nova:user uuid="192b7bd8dd234dceadc22ba7bb092344">tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member</nova:user>
Jul 24 15:04:06 user nova-compute[70645]:         <nova:project uuid="bab8baa391424072ba5bcea7f54f0242">tempest-ServerBootFromVolumeStableRescueTest-1550895590</nova:project>
Jul 24 15:04:06 user nova-compute[70645]:       </nova:owner>
Jul 24 15:04:06 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:04:06 user nova-compute[70645]:       <nova:ports>
Jul 24 15:04:06 user nova-compute[70645]:         <nova:port uuid="fb210eeb-c5aa-4c30-988b-772930ecc039">
Jul 24 15:04:06 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 15:04:06 user nova-compute[70645]:         </nova:port>
Jul 24 15:04:06 user nova-compute[70645]:       </nova:ports>
Jul 24 15:04:06 user nova-compute[70645]:     </nova:instance>
Jul 24 15:04:06 user nova-compute[70645]:   </metadata>
Jul 24 15:04:06 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:04:06 user nova-compute[70645]:     <system>
Jul 24 15:04:06 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:04:06 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:04:06 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:04:06 user nova-compute[70645]:       <entry name="serial">4f686b79-b22d-4453-ae35-7a1133d7aa86</entry>
Jul 24 15:04:06 user nova-compute[70645]:       <entry name="uuid">4f686b79-b22d-4453-ae35-7a1133d7aa86</entry>
Jul 24 15:04:06 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:04:06 user nova-compute[70645]:     </system>
Jul 24 15:04:06 user nova-compute[70645]:   </sysinfo>
Jul 24 15:04:06 user nova-compute[70645]:   <os>
Jul 24 15:04:06 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:04:06 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:04:06 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:04:06 user nova-compute[70645]:   </os>
Jul 24 15:04:06 user nova-compute[70645]:   <features>
Jul 24 15:04:06 user nova-compute[70645]:     <acpi/>
Jul 24 15:04:06 user nova-compute[70645]:     <apic/>
Jul 24 15:04:06 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:04:06 user nova-compute[70645]:   </features>
Jul 24 15:04:06 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:04:06 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:04:06 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:04:06 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:04:06 user nova-compute[70645]:   </clock>
Jul 24 15:04:06 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:04:06 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:04:06 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:04:06 user nova-compute[70645]:   </cpu>
Jul 24 15:04:06 user nova-compute[70645]:   <devices>
Jul 24 15:04:06 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:04:06 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:04:06 user nova-compute[70645]:       <source dev="/dev/sdd"/>
Jul 24 15:04:06 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:04:06 user nova-compute[70645]:       <serial>96ff20c5-6dd6-430e-9a18-81c906547b37</serial>
Jul 24 15:04:06 user nova-compute[70645]:     </disk>
Jul 24 15:04:06 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:04:06 user nova-compute[70645]:       <mac address="fa:16:3e:63:a1:8d"/>
Jul 24 15:04:06 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:04:06 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:04:06 user nova-compute[70645]:       <target dev="tapfb210eeb-c5"/>
Jul 24 15:04:06 user nova-compute[70645]:     </interface>
Jul 24 15:04:06 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:04:06 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/console.log" append="off"/>
Jul 24 15:04:06 user nova-compute[70645]:     </serial>
Jul 24 15:04:06 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:04:06 user nova-compute[70645]:     <video>
Jul 24 15:04:06 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:04:06 user nova-compute[70645]:     </video>
Jul 24 15:04:06 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:04:06 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:04:06 user nova-compute[70645]:     </rng>
Jul 24 15:04:06 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:04:06 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:04:06 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:04:06 user nova-compute[70645]:     </memballoon>
Jul 24 15:04:06 user nova-compute[70645]:   </devices>
Jul 24 15:04:06 user nova-compute[70645]: </domain>
Jul 24 15:04:06 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1406665233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1406665233',id=27,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-ttaam4dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:03:52Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=4f686b79-b22d-4453-ae35-7a1133d7aa86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a1:8d,bridge_name='br-int',has_traffic_filtering=True,id=fb210eeb-c5aa-4c30-988b-772930ecc039,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb210eeb-c5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG os_vif [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a1:8d,bridge_name='br-int',has_traffic_filtering=True,id=fb210eeb-c5aa-4c30-988b-772930ecc039,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb210eeb-c5') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb210eeb-c5, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb210eeb-c5, col_values=(('external_ids', {'iface-id': 'fb210eeb-c5aa-4c30-988b-772930ecc039', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:a1:8d', 'vm-uuid': '4f686b79-b22d-4453-ae35-7a1133d7aa86'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:06 user nova-compute[70645]: INFO os_vif [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a1:8d,bridge_name='br-int',has_traffic_filtering=True,id=fb210eeb-c5aa-4c30-988b-772930ecc039,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb210eeb-c5')
Jul 24 15:04:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:04:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No VIF found with MAC fa:16:3e:63:a1:8d, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:04:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:08 user nova-compute[70645]: DEBUG nova.compute.manager [req-7db283a5-5eed-4264-abcc-25a3b36e33dc req-f8271ecd-3df3-4e31-8a66-3d8bad6bc236 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7db283a5-5eed-4264-abcc-25a3b36e33dc req-f8271ecd-3df3-4e31-8a66-3d8bad6bc236 service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7db283a5-5eed-4264-abcc-25a3b36e33dc req-f8271ecd-3df3-4e31-8a66-3d8bad6bc236 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7db283a5-5eed-4264-abcc-25a3b36e33dc req-f8271ecd-3df3-4e31-8a66-3d8bad6bc236 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:08 user nova-compute[70645]: DEBUG nova.compute.manager [req-7db283a5-5eed-4264-abcc-25a3b36e33dc req-f8271ecd-3df3-4e31-8a66-3d8bad6bc236 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:08 user nova-compute[70645]: WARNING nova.compute.manager [req-7db283a5-5eed-4264-abcc-25a3b36e33dc req-f8271ecd-3df3-4e31-8a66-3d8bad6bc236 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received unexpected event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with vm_state building and task_state spawning.
Jul 24 15:04:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:08 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211033.5636961, 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:04:08 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] VM Stopped (Lifecycle Event)
Jul 24 15:04:08 user nova-compute[70645]: DEBUG nova.compute.manager [None req-79eaabab-7568-4110-b560-ad7b4dbf8738 None None] [instance: 5bbb9398-3bbf-4e88-b0b1-6fd2d38d50c9] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211050.2615616, 4f686b79-b22d-4453-ae35-7a1133d7aa86 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:04:10 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] VM Resumed (Lifecycle Event)
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:04:10 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Instance spawned successfully.
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-fd911e4a-0b69-4a6d-937a-e9cdf64be5e4 req-72004d75-dbb7-4b19-853d-62252a3f6d03 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd911e4a-0b69-4a6d-937a-e9cdf64be5e4 req-72004d75-dbb7-4b19-853d-62252a3f6d03 service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd911e4a-0b69-4a6d-937a-e9cdf64be5e4 req-72004d75-dbb7-4b19-853d-62252a3f6d03 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd911e4a-0b69-4a6d-937a-e9cdf64be5e4 req-72004d75-dbb7-4b19-853d-62252a3f6d03 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-fd911e4a-0b69-4a6d-937a-e9cdf64be5e4 req-72004d75-dbb7-4b19-853d-62252a3f6d03 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:10 user nova-compute[70645]: WARNING nova.compute.manager [req-fd911e4a-0b69-4a6d-937a-e9cdf64be5e4 req-72004d75-dbb7-4b19-853d-62252a3f6d03 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received unexpected event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with vm_state building and task_state spawning.
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:04:10 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211050.2656963, 4f686b79-b22d-4453-ae35-7a1133d7aa86 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:04:10 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] VM Started (Lifecycle Event)
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:04:10 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:04:10 user nova-compute[70645]: INFO nova.compute.manager [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Took 5.53 seconds to spawn the instance on the hypervisor.
Jul 24 15:04:10 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:04:10 user nova-compute[70645]: INFO nova.compute.manager [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Took 19.21 seconds to build instance.
Jul 24 15:04:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4c272fe5-7eb5-45e7-81e0-4bda984a755a tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.343s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:15 user nova-compute[70645]: INFO nova.compute.manager [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Detaching volume 05b990d4-add3-45f4-9e5d-b3c9bc168e98
Jul 24 15:04:15 user nova-compute[70645]: INFO nova.virt.block_device [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Attempting to driver detach volume 05b990d4-add3-45f4-9e5d-b3c9bc168e98 from mountpoint /dev/vdb
Jul 24 15:04:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Attempting to detach device vdb from instance 734abf9a-96dd-40b4-9b68-2d42fa079216 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:04:15 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:04:15 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:04:15 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:04:15 user nova-compute[70645]:   <serial>05b990d4-add3-45f4-9e5d-b3c9bc168e98</serial>
Jul 24 15:04:15 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 15:04:15 user nova-compute[70645]: </disk>
Jul 24 15:04:15 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:04:15 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully detached device vdb from instance 734abf9a-96dd-40b4-9b68-2d42fa079216 from the persistent domain config.
Jul 24 15:04:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 734abf9a-96dd-40b4-9b68-2d42fa079216 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:04:15 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:04:15 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:04:15 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:04:15 user nova-compute[70645]:   <serial>05b990d4-add3-45f4-9e5d-b3c9bc168e98</serial>
Jul 24 15:04:15 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 15:04:15 user nova-compute[70645]: </disk>
Jul 24 15:04:15 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211055.7381449, 734abf9a-96dd-40b4-9b68-2d42fa079216 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:04:15 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully detached device vdb from instance 734abf9a-96dd-40b4-9b68-2d42fa079216 from the live domain config.
Jul 24 15:04:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgHOotWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:04:15 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3b25dd-f545-42e3-9075-329703943467]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b6cee5-52c1-4c73-b3ac-9ed846981303]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:04:15 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:04:15 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:04:15 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:04:15 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:04:15 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:04:15 user nova-compute[70645]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 (non-flash)
Jul 24 15:04:15 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:04:15 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba942cf7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebd7ec5-b3a3-4ab4-9fb4-945d8871a712]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[54edab5d-0fd9-49d2-90f4-7d315bc0c132]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae83ca-78e2-4dd2-8293-be14097d31bf]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa2f37c-16d4-44f7-a30b-10a9dd1099d2]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[411bee0d-8efd-44ff-b6cd-a8d0ef5b9263]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ebf502-c081-4662-9a98-2140d530d47d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260]
Jul 24 15:04:16 user nova-compute[70645]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98, portal: 172.16.0.220,3260] successful.
Jul 24 15:04:16 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b990d4-add3-45f4-9e5d-b3c9bc168e98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a735ac-4b87-477c-982b-2d62961e9816]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] <== disconnect_volume: return (321ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG nova.objects.instance [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-91c1e4e7-d265-4b84-b66b-d0e4d25f96a8 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-92ca15c6-7454-4d8f-84d7-a916d7e5f124 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-92ca15c6-7454-4d8f-84d7-a916d7e5f124 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-92ca15c6-7454-4d8f-84d7-a916d7e5f124 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-92ca15c6-7454-4d8f-84d7-a916d7e5f124 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70645) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG nova.objects.instance [None req-92ca15c6-7454-4d8f-84d7-a916d7e5f124 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG nova.compute.manager [req-6691cd67-fb1c-4b9a-814d-8cd0e1495ea7 req-3a2946b8-f371-4886-8cfb-dd244105da1a service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6691cd67-fb1c-4b9a-814d-8cd0e1495ea7 req-3a2946b8-f371-4886-8cfb-dd244105da1a service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6691cd67-fb1c-4b9a-814d-8cd0e1495ea7 req-3a2946b8-f371-4886-8cfb-dd244105da1a service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6691cd67-fb1c-4b9a-814d-8cd0e1495ea7 req-3a2946b8-f371-4886-8cfb-dd244105da1a service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:17 user nova-compute[70645]: DEBUG nova.compute.manager [req-6691cd67-fb1c-4b9a-814d-8cd0e1495ea7 req-3a2946b8-f371-4886-8cfb-dd244105da1a service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:17 user nova-compute[70645]: WARNING nova.compute.manager [req-6691cd67-fb1c-4b9a-814d-8cd0e1495ea7 req-3a2946b8-f371-4886-8cfb-dd244105da1a service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state active and task_state powering-off.
Jul 24 15:04:18 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance destroyed successfully.
Jul 24 15:04:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-92ca15c6-7454-4d8f-84d7-a916d7e5f124 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:04:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-92ca15c6-7454-4d8f-84d7-a916d7e5f124 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.888s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-36b6d7ee-896c-4683-8254-82bdf22812ca req-f93fad01-ec93-4015-9630-8e21c842138a service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-36b6d7ee-896c-4683-8254-82bdf22812ca req-f93fad01-ec93-4015-9630-8e21c842138a service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-36b6d7ee-896c-4683-8254-82bdf22812ca req-f93fad01-ec93-4015-9630-8e21c842138a service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-36b6d7ee-896c-4683-8254-82bdf22812ca req-f93fad01-ec93-4015-9630-8e21c842138a service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-36b6d7ee-896c-4683-8254-82bdf22812ca req-f93fad01-ec93-4015-9630-8e21c842138a service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:19 user nova-compute[70645]: WARNING nova.compute.manager [req-36b6d7ee-896c-4683-8254-82bdf22812ca req-f93fad01-ec93-4015-9630-8e21c842138a service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state stopped and task_state None.
Jul 24 15:04:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:04:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:04:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:04:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:21 user nova-compute[70645]: INFO nova.compute.manager [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Terminating instance
Jul 24 15:04:21 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-56c2a53f-3aa2-4d35-8893-96b8b99c23e6 req-ea7beb8c-cc38-4ad3-a3cd-ecee99486ea6 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-unplugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-56c2a53f-3aa2-4d35-8893-96b8b99c23e6 req-ea7beb8c-cc38-4ad3-a3cd-ecee99486ea6 service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-56c2a53f-3aa2-4d35-8893-96b8b99c23e6 req-ea7beb8c-cc38-4ad3-a3cd-ecee99486ea6 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-56c2a53f-3aa2-4d35-8893-96b8b99c23e6 req-ea7beb8c-cc38-4ad3-a3cd-ecee99486ea6 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-56c2a53f-3aa2-4d35-8893-96b8b99c23e6 req-ea7beb8c-cc38-4ad3-a3cd-ecee99486ea6 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-unplugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-56c2a53f-3aa2-4d35-8893-96b8b99c23e6 req-ea7beb8c-cc38-4ad3-a3cd-ecee99486ea6 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-unplugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Instance destroyed successfully.
Jul 24 15:04:22 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lazy-loading 'resources' on Instance uuid 460ae655-2955-4a45-9b12-2a3ddd9f448b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887972996',display_name='tempest-ServerActionsTestOtherB-server-1887972996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887972996',id=14,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMleqYhBZCEEjJJsaMEuckPLdRSggssXX58+jSUDWV4RWgJi1aCvZ7GKXmFcDgd20RUebLSGWW0+tvwfBRktv2c+QmVz9Ve3ikoCtp5+5Q7Q8T6xY4TIWukXrdzPtz1wFA==',key_name='tempest-keypair-1765023642',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:01:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a7fb98af2b84c51a448d39d957f5f6a',ramdisk_id='',reservation_id='r-fex15wu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-589948319',owner_user_name='tempest-ServerActionsTestOtherB-589948319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01c8ead2665a44c8a24dd89ee3b18a72',uuid=460ae655-2955-4a45-9b12-2a3ddd9f448b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converting VIF {"id": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "address": "fa:16:3e:46:ef:9d", "network": {"id": "596444e8-cf22-4bf3-9d43-a7d9fdd8c223", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1563413765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7fb98af2b84c51a448d39d957f5f6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a56f8d6-1f", "ovs_interfaceid": "3a56f8d6-1f50-46b0-949f-a64d933dd392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_vif [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a56f8d6-1f, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:22 user nova-compute[70645]: INFO os_vif [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a56f8d6-1f50-46b0-949f-a64d933dd392,network=Network(596444e8-cf22-4bf3-9d43-a7d9fdd8c223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a56f8d6-1f')
Jul 24 15:04:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYVBiqzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:04:22 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40c8c49-9209-4ba6-a61c-33a5ab94477f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0ef0a6-4c50-41a0-b595-51cfd8fafa80]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:04:22 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:04:22 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:04:22 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:04:22 user nova-compute[70645]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 (non-flash)
Jul 24 15:04:22 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:04:22 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbaa1cc3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2453b3ac-27ce-4a51-9a82-7d7876bcf4bd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb9abcd-0cbd-41b2-88eb-3d46f249b479]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f563122-1dd9-4b41-ba38-09f481e3de99]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dd69b5-d3b3-4537-8fad-8cca99b8baa8]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e752ea-ddd8-487c-b180-58ec3e978688]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1c057a-e88a-46ea-9b8b-b00cff49b53d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260]
Jul 24 15:04:22 user nova-compute[70645]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153, portal: 172.16.0.220,3260] successful.
Jul 24 15:04:22 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9814e40c-d816-44f0-9243-eb5d61f88153 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[78208d5b-e807-41c8-bbe8-007f34693c3e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.532s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] <== disconnect_volume: return (534ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:04:22 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Deleting instance files /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b_del
Jul 24 15:04:22 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Deletion of /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b_del complete
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json" returned: 1 in 0.180s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk --force-share --output=json' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:04:22 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000000e, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/460ae655-2955-4a45-9b12-2a3ddd9f448b/disk
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:22 user nova-compute[70645]: INFO nova.compute.manager [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Took 1.59 seconds to destroy the instance on the hypervisor.
Jul 24 15:04:22 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:04:22 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-5fdff5d1-dd8d-45cf-b7be-cfd7591cbaa7 req-bfb3854e-76df-496a-af18-f5b65ed98775 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5fdff5d1-dd8d-45cf-b7be-cfd7591cbaa7 req-bfb3854e-76df-496a-af18-f5b65ed98775 service nova] Acquiring lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5fdff5d1-dd8d-45cf-b7be-cfd7591cbaa7 req-bfb3854e-76df-496a-af18-f5b65ed98775 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5fdff5d1-dd8d-45cf-b7be-cfd7591cbaa7 req-bfb3854e-76df-496a-af18-f5b65ed98775 service nova] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-5fdff5d1-dd8d-45cf-b7be-cfd7591cbaa7 req-bfb3854e-76df-496a-af18-f5b65ed98775 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] No waiting events found dispatching network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:23 user nova-compute[70645]: WARNING nova.compute.manager [req-5fdff5d1-dd8d-45cf-b7be-cfd7591cbaa7 req-bfb3854e-76df-496a-af18-f5b65ed98775 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received unexpected event network-vif-plugged-3a56f8d6-1f50-46b0-949f-a64d933dd392 for instance with vm_state active and task_state deleting.
Jul 24 15:04:24 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:24 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Took 1.21 seconds to deallocate network for instance.
Jul 24 15:04:24 user nova-compute[70645]: DEBUG nova.compute.manager [req-9546ab28-9382-4471-a295-ba70f64cd3f7 req-766338b8-ab0f-4837-8e21-09cf6854ee16 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Received event network-vif-deleted-3a56f8d6-1f50-46b0-949f-a64d933dd392 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:24 user nova-compute[70645]: INFO nova.compute.manager [req-9546ab28-9382-4471-a295-ba70f64cd3f7 req-766338b8-ab0f-4837-8e21-09cf6854ee16 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Neutron deleted interface 3a56f8d6-1f50-46b0-949f-a64d933dd392; detaching it from the instance and deleting it from the info cache
Jul 24 15:04:24 user nova-compute[70645]: DEBUG nova.network.neutron [req-9546ab28-9382-4471-a295-ba70f64cd3f7 req-766338b8-ab0f-4837-8e21-09cf6854ee16 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG nova.compute.manager [req-9546ab28-9382-4471-a295-ba70f64cd3f7 req-766338b8-ab0f-4837-8e21-09cf6854ee16 service nova] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Detach interface failed, port_id=3a56f8d6-1f50-46b0-949f-a64d933dd392, reason: Instance 460ae655-2955-4a45-9b12-2a3ddd9f448b could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:25 user nova-compute[70645]: INFO nova.compute.manager [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Took 0.83 seconds to detach 1 volumes for instance.
Jul 24 15:04:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Refreshing inventories for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Updating ProviderTree inventory for provider a0cf5b80-69d2-4191-894e-a498eab7d688 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Refreshing aggregate associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, aggregates: None {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Refreshing trait associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:25 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:04:25 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:04:25 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7277MB free_disk=25.228713989257812GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.872s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.207s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:25 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Deleted allocations for instance 460ae655-2955-4a45-9b12-2a3ddd9f448b
Jul 24 15:04:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d3c89fc4-7ee6-40ee-a964-c4714acf4126 tempest-ServerActionsTestOtherB-589948319 tempest-ServerActionsTestOtherB-589948319-project-member] Lock "460ae655-2955-4a45-9b12-2a3ddd9f448b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.725s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 6fafa215-3ee5-4efb-816a-1d9f72e667da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 734abf9a-96dd-40b4-9b68-2d42fa079216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 07adce07-b416-44fb-b548-17b8cd0d8168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 9ea99927-77d9-4e98-b435-d4c781031d90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 8ad33774-2d1b-480d-871d-f422c941c806 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 4f686b79-b22d-4453-ae35-7a1133d7aa86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:04:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:27 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:04:27 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:04:27 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:04:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:04:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:04:27 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:04:28 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Updating instance_info_cache with network_info: [{"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:04:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:04:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:04:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:04:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:04:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:04:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:04:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:04:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:04:29 user nova-compute[70645]: INFO nova.compute.manager [None req-d5063e96-c01b-49c9-affb-54ce187e4838 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Unrescuing
Jul 24 15:04:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d5063e96-c01b-49c9-affb-54ce187e4838 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:04:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d5063e96-c01b-49c9-affb-54ce187e4838 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquired lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:04:29 user nova-compute[70645]: DEBUG nova.network.neutron [None req-d5063e96-c01b-49c9-affb-54ce187e4838 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:04:29 user nova-compute[70645]: DEBUG nova.network.neutron [None req-d5063e96-c01b-49c9-affb-54ce187e4838 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Updating instance_info_cache with network_info: [{"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:04:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d5063e96-c01b-49c9-affb-54ce187e4838 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Releasing lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:04:29 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d5063e96-c01b-49c9-affb-54ce187e4838 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'flavor' on Instance uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:04:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-a304f7e4-e614-43a3-a99a-8e82d0035906 req-bd2e9dbd-c73b-41ed-9087-53e55716889b service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-unplugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a304f7e4-e614-43a3-a99a-8e82d0035906 req-bd2e9dbd-c73b-41ed-9087-53e55716889b service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a304f7e4-e614-43a3-a99a-8e82d0035906 req-bd2e9dbd-c73b-41ed-9087-53e55716889b service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a304f7e4-e614-43a3-a99a-8e82d0035906 req-bd2e9dbd-c73b-41ed-9087-53e55716889b service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-a304f7e4-e614-43a3-a99a-8e82d0035906 req-bd2e9dbd-c73b-41ed-9087-53e55716889b service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-unplugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:30 user nova-compute[70645]: WARNING nova.compute.manager [req-a304f7e4-e614-43a3-a99a-8e82d0035906 req-bd2e9dbd-c73b-41ed-9087-53e55716889b service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received unexpected event network-vif-unplugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:04:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Instance destroyed successfully.
Jul 24 15:04:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:32 user nova-compute[70645]: WARNING nova.compute.manager [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received unexpected event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:04:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:32 user nova-compute[70645]: WARNING nova.compute.manager [req-ab2a7382-06a8-418a-b9e5-11e0bd9fdd68 req-5f05e18f-f0f7-4f59-a3a5-b047cd3d8b7f service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received unexpected event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:04:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:33 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211058.2669907, 734abf9a-96dd-40b4-9b68-2d42fa079216 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:04:33 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] VM Stopped (Lifecycle Event)
Jul 24 15:04:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-cdd7b487-3294-4b6b-94e8-ba93f1ae0e4d None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:04:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-cdd7b487-3294-4b6b-94e8-ba93f1ae0e4d None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:04:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 74c53188-2399-4515-94e6-4ff3e94d7559 due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 15:04:33 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211073.879922, 74c53188-2399-4515-94e6-4ff3e94d7559 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:04:33 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] VM Resumed (Lifecycle Event)
Jul 24 15:04:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d5063e96-c01b-49c9-affb-54ce187e4838 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:04:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:04:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:04:33 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 15:04:33 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211073.880909, 74c53188-2399-4515-94e6-4ff3e94d7559 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:04:33 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] VM Started (Lifecycle Event)
Jul 24 15:04:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:04:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:04:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-94529c9c-e74e-4702-84b7-80e8fc9d50ec req-5e3afe14-9e6e-4532-bfad-140d9ee9df7d service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-94529c9c-e74e-4702-84b7-80e8fc9d50ec req-5e3afe14-9e6e-4532-bfad-140d9ee9df7d service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-94529c9c-e74e-4702-84b7-80e8fc9d50ec req-5e3afe14-9e6e-4532-bfad-140d9ee9df7d service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-94529c9c-e74e-4702-84b7-80e8fc9d50ec req-5e3afe14-9e6e-4532-bfad-140d9ee9df7d service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-94529c9c-e74e-4702-84b7-80e8fc9d50ec req-5e3afe14-9e6e-4532-bfad-140d9ee9df7d service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:34 user nova-compute[70645]: WARNING nova.compute.manager [req-94529c9c-e74e-4702-84b7-80e8fc9d50ec req-5e3afe14-9e6e-4532-bfad-140d9ee9df7d service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received unexpected event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with vm_state active and task_state None.
Jul 24 15:04:37 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211062.1690605, 460ae655-2955-4a45-9b12-2a3ddd9f448b => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:04:37 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] VM Stopped (Lifecycle Event)
Jul 24 15:04:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-bf87939f-829c-4098-9631-25aa2ac5bd71 None None] [instance: 460ae655-2955-4a45-9b12-2a3ddd9f448b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:04:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:45 user nova-compute[70645]: INFO nova.compute.manager [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Terminating instance
Jul 24 15:04:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-4aeb00be-8c55-4b43-a4b5-c3c29448cdc7 req-c263004e-e3d3-4a90-a46c-a69f4b4ca38f service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-vif-unplugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4aeb00be-8c55-4b43-a4b5-c3c29448cdc7 req-c263004e-e3d3-4a90-a46c-a69f4b4ca38f service nova] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4aeb00be-8c55-4b43-a4b5-c3c29448cdc7 req-c263004e-e3d3-4a90-a46c-a69f4b4ca38f service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4aeb00be-8c55-4b43-a4b5-c3c29448cdc7 req-c263004e-e3d3-4a90-a46c-a69f4b4ca38f service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-4aeb00be-8c55-4b43-a4b5-c3c29448cdc7 req-c263004e-e3d3-4a90-a46c-a69f4b4ca38f service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] No waiting events found dispatching network-vif-unplugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-4aeb00be-8c55-4b43-a4b5-c3c29448cdc7 req-c263004e-e3d3-4a90-a46c-a69f4b4ca38f service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-vif-unplugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:04:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Instance destroyed successfully.
Jul 24 15:04:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'resources' on Instance uuid 9ea99927-77d9-4e98-b435-d4c781031d90 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:04:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T14:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1918489519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1918489519',id=21,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy5TsjK5j9HCl9mLdX6AaZM+2QGOGiecv426IZtv6DpfNck1CagDBFF7p/xYc78uCqhIY0GMZJHT90HiD7ZmVpYpGtK6yNYvpcTLHn4cg/C/ja0/grJ5zcOTPgsQ91Ggg==',key_name='tempest-keypair-2073152801',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-gcl1160i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=9ea99927-77d9-4e98-b435-d4c781031d90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:04:46 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "address": "fa:16:3e:38:37:ef", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e43646-0d", "ovs_interfaceid": "84e43646-0d11-4aad-8ace-40d9d0d4aacc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:04:46 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:04:46 user nova-compute[70645]: DEBUG os_vif [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:04:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84e43646-0d, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:04:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:04:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:46 user nova-compute[70645]: INFO os_vif [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:37:ef,bridge_name='br-int',has_traffic_filtering=True,id=84e43646-0d11-4aad-8ace-40d9d0d4aacc,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e43646-0d')
Jul 24 15:04:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Deleting instance files /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90_del
Jul 24 15:04:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Deletion of /opt/stack/data/nova/instances/9ea99927-77d9-4e98-b435-d4c781031d90_del complete
Jul 24 15:04:46 user nova-compute[70645]: INFO nova.compute.manager [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 24 15:04:46 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:04:46 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:04:46 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:04:47 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Took 1.01 seconds to deallocate network for instance.
Jul 24 15:04:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-3a38e1ea-af25-42bb-85b7-d194e109d693 req-3f54740b-3619-4f8c-8770-95a02471529b service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-vif-deleted-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:47 user nova-compute[70645]: INFO nova.compute.manager [req-3a38e1ea-af25-42bb-85b7-d194e109d693 req-3f54740b-3619-4f8c-8770-95a02471529b service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Neutron deleted interface 84e43646-0d11-4aad-8ace-40d9d0d4aacc; detaching it from the instance and deleting it from the info cache
Jul 24 15:04:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-3a38e1ea-af25-42bb-85b7-d194e109d693 req-3f54740b-3619-4f8c-8770-95a02471529b service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-3a38e1ea-af25-42bb-85b7-d194e109d693 req-3f54740b-3619-4f8c-8770-95a02471529b service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Detach interface failed, port_id=84e43646-0d11-4aad-8ace-40d9d0d4aacc, reason: Instance 9ea99927-77d9-4e98-b435-d4c781031d90 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-f3021e8a-7aad-4caf-ab84-d9039253ab9a req-bf5dedd1-e508-4ba6-932e-d1e52f8d7fa9 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f3021e8a-7aad-4caf-ab84-d9039253ab9a req-bf5dedd1-e508-4ba6-932e-d1e52f8d7fa9 service nova] Acquiring lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f3021e8a-7aad-4caf-ab84-d9039253ab9a req-bf5dedd1-e508-4ba6-932e-d1e52f8d7fa9 service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f3021e8a-7aad-4caf-ab84-d9039253ab9a req-bf5dedd1-e508-4ba6-932e-d1e52f8d7fa9 service nova] Lock "9ea99927-77d9-4e98-b435-d4c781031d90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-f3021e8a-7aad-4caf-ab84-d9039253ab9a req-bf5dedd1-e508-4ba6-932e-d1e52f8d7fa9 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] No waiting events found dispatching network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:47 user nova-compute[70645]: WARNING nova.compute.manager [req-f3021e8a-7aad-4caf-ab84-d9039253ab9a req-bf5dedd1-e508-4ba6-932e-d1e52f8d7fa9 service nova] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Received unexpected event network-vif-plugged-84e43646-0d11-4aad-8ace-40d9d0d4aacc for instance with vm_state deleted and task_state None.
Jul 24 15:04:47 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Deleted allocations for instance 9ea99927-77d9-4e98-b435-d4c781031d90
Jul 24 15:04:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3c5065da-0c98-4b13-8867-96e0f14ecbde tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "9ea99927-77d9-4e98-b435-d4c781031d90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.578s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:48 user nova-compute[70645]: INFO nova.compute.manager [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Terminating instance
Jul 24 15:04:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:04:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Instance destroyed successfully.
Jul 24 15:04:49 user nova-compute[70645]: DEBUG nova.objects.instance [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lazy-loading 'resources' on Instance uuid 6fafa215-3ee5-4efb-816a-1d9f72e667da {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1233785489',display_name='tempest-ServerStableDeviceRescueTest-server-1233785489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1233785489',id=17,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXs5WJpPEztU3bfcQKgE/HpXK8WmqpvoWAYUQl0M18pIkCkgsIYQ1MmCYCpsMYDnyC9pUZ7q7T6GsoqZ5+Vq8EmW7X8NdZgpv4sxbNieOyY+y5vMm+LYNVL7UXtGRhQFA==',key_name='tempest-keypair-115789889',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:01:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54c90b1c32384354a8ba5140a846be6f',ramdisk_id='',reservation_id='r-1w9tjbeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-494685022',owner_user_name='tempest-ServerStableDeviceRescueTest-494685022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1adea3e2d58a473b9f7f40a21f7c7bea',uuid=6fafa215-3ee5-4efb-816a-1d9f72e667da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Converting VIF {"id": "02ca6838-89e2-41bc-a858-dc7a007f7960", "address": "fa:16:3e:5c:be:ca", "network": {"id": "c2cb753b-9202-48c0-923f-2a9713209b0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1179320719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c90b1c32384354a8ba5140a846be6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ca6838-89", "ovs_interfaceid": "02ca6838-89e2-41bc-a858-dc7a007f7960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:be:ca,bridge_name='br-int',has_traffic_filtering=True,id=02ca6838-89e2-41bc-a858-dc7a007f7960,network=Network(c2cb753b-9202-48c0-923f-2a9713209b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ca6838-89') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG os_vif [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:be:ca,bridge_name='br-int',has_traffic_filtering=True,id=02ca6838-89e2-41bc-a858-dc7a007f7960,network=Network(c2cb753b-9202-48c0-923f-2a9713209b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ca6838-89') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02ca6838-89, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:49 user nova-compute[70645]: INFO os_vif [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:be:ca,bridge_name='br-int',has_traffic_filtering=True,id=02ca6838-89e2-41bc-a858-dc7a007f7960,network=Network(c2cb753b-9202-48c0-923f-2a9713209b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ca6838-89')
Jul 24 15:04:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Deleting instance files /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da_del
Jul 24 15:04:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Deletion of /opt/stack/data/nova/instances/6fafa215-3ee5-4efb-816a-1d9f72e667da_del complete
Jul 24 15:04:49 user nova-compute[70645]: INFO nova.compute.manager [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 24 15:04:49 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-unplugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-unplugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-unplugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] Acquiring lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] No waiting events found dispatching network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:04:49 user nova-compute[70645]: WARNING nova.compute.manager [req-39be0147-19ce-4924-89d4-d435b3f337bf req-fd9a3a27-0bba-4c1b-b695-d2fa20186da1 service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received unexpected event network-vif-plugged-02ca6838-89e2-41bc-a858-dc7a007f7960 for instance with vm_state active and task_state deleting.
Jul 24 15:04:50 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:04:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-a57e064a-1fe2-42ba-ab44-6cfe1fcdb715 req-305502f6-0959-4fed-91db-f01a98676dcd service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Received event network-vif-deleted-02ca6838-89e2-41bc-a858-dc7a007f7960 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:04:50 user nova-compute[70645]: INFO nova.compute.manager [req-a57e064a-1fe2-42ba-ab44-6cfe1fcdb715 req-305502f6-0959-4fed-91db-f01a98676dcd service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Neutron deleted interface 02ca6838-89e2-41bc-a858-dc7a007f7960; detaching it from the instance and deleting it from the info cache
Jul 24 15:04:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-a57e064a-1fe2-42ba-ab44-6cfe1fcdb715 req-305502f6-0959-4fed-91db-f01a98676dcd service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:04:50 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Took 0.88 seconds to deallocate network for instance.
Jul 24 15:04:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-a57e064a-1fe2-42ba-ab44-6cfe1fcdb715 req-305502f6-0959-4fed-91db-f01a98676dcd service nova] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Detach interface failed, port_id=02ca6838-89e2-41bc-a858-dc7a007f7960, reason: Instance 6fafa215-3ee5-4efb-816a-1d9f72e667da could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:04:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:50 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:04:50 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:04:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:50 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Deleted allocations for instance 6fafa215-3ee5-4efb-816a-1d9f72e667da
Jul 24 15:04:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fb22b048-e002-46cb-82b0-8a8b4da6d6aa tempest-ServerStableDeviceRescueTest-494685022 tempest-ServerStableDeviceRescueTest-494685022-project-member] Lock "6fafa215-3ee5-4efb-816a-1d9f72e667da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.358s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:04:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:04:57 user nova-compute[70645]: INFO nova.compute.claims [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Claim successful on node user
Jul 24 15:04:58 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:04:58 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:04:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG nova.policy [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cfc37f67c214e638adb1409d4db18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2edf2107c94e1195d57905b59344fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:04:58 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Creating image(s)
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "/opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "/opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "/opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk 1073741824" returned: 0 in 0.060s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Cannot resize image /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG nova.objects.instance [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'migration_context' on Instance uuid 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Ensure instance console log exists: /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:04:59 user nova-compute[70645]: DEBUG nova.network.neutron [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Successfully created port: 5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Successfully updated port: 5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "refresh_cache-21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquired lock "refresh_cache-21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-0491db87-e7ad-46c2-bf35-f47d89ac1fb4 req-9b5382dd-d593-4b24-9337-7267f2d0563d service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Received event network-changed-5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-0491db87-e7ad-46c2-bf35-f47d89ac1fb4 req-9b5382dd-d593-4b24-9337-7267f2d0563d service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Refreshing instance network info cache due to event network-changed-5db4c40e-e5fe-4aff-82c2-33a2bc44478f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0491db87-e7ad-46c2-bf35-f47d89ac1fb4 req-9b5382dd-d593-4b24-9337-7267f2d0563d service nova] Acquiring lock "refresh_cache-21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Updating instance_info_cache with network_info: [{"id": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "address": "fa:16:3e:c4:77:ef", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db4c40e-e5", "ovs_interfaceid": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Releasing lock "refresh_cache-21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.compute.manager [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Instance network_info: |[{"id": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "address": "fa:16:3e:c4:77:ef", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db4c40e-e5", "ovs_interfaceid": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0491db87-e7ad-46c2-bf35-f47d89ac1fb4 req-9b5382dd-d593-4b24-9337-7267f2d0563d service nova] Acquired lock "refresh_cache-21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.network.neutron [req-0491db87-e7ad-46c2-bf35-f47d89ac1fb4 req-9b5382dd-d593-4b24-9337-7267f2d0563d service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Refreshing network info cache for port 5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Start _get_guest_xml network_info=[{"id": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "address": "fa:16:3e:c4:77:ef", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db4c40e-e5", "ovs_interfaceid": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:05:00 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:00 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:04:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-503794527',display_name='tempest-VolumesSnapshotTestJSON-instance-503794527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-503794527',id=28,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTa4gwabuPNtKe6tm4gcamWd3VcC2VKsMuYX0Ep9APf8uGNQh4cL06TLre3rqr6NOi6LfNDyAYMPUTf68B/Q4HCtn4saVfrML/W/TLG4As3b86FvBV4JkbvpHr1XfXkaA==',key_name='tempest-keypair-205122020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2edf2107c94e1195d57905b59344fb',ramdisk_id='',reservation_id='r-u8pw8uhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1862271743',owner_user_name='tempest-VolumesSnapshotTestJSON-1862271743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:04:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cfc37f67c214e638adb1409d4db18d6',uuid=21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "address": "fa:16:3e:c4:77:ef", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db4c40e-e5", "ovs_interfaceid": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converting VIF {"id": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "address": "fa:16:3e:c4:77:ef", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db4c40e-e5", "ovs_interfaceid": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:77:ef,bridge_name='br-int',has_traffic_filtering=True,id=5db4c40e-e5fe-4aff-82c2-33a2bc44478f,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db4c40e-e5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.objects.instance [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'pci_devices' on Instance uuid 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:05:00 user nova-compute[70645]:   <uuid>21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e</uuid>
Jul 24 15:05:00 user nova-compute[70645]:   <name>instance-0000001c</name>
Jul 24 15:05:00 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:05:00 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:05:00 user nova-compute[70645]:   <metadata>
Jul 24 15:05:00 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:05:00 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:05:00 user nova-compute[70645]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-503794527</nova:name>
Jul 24 15:05:00 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:05:00</nova:creationTime>
Jul 24 15:05:00 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:05:00 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:05:00 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:05:00 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:05:00 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:05:00 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:05:00 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:05:00 user nova-compute[70645]:       <nova:owner>
Jul 24 15:05:00 user nova-compute[70645]:         <nova:user uuid="4cfc37f67c214e638adb1409d4db18d6">tempest-VolumesSnapshotTestJSON-1862271743-project-member</nova:user>
Jul 24 15:05:00 user nova-compute[70645]:         <nova:project uuid="5f2edf2107c94e1195d57905b59344fb">tempest-VolumesSnapshotTestJSON-1862271743</nova:project>
Jul 24 15:05:00 user nova-compute[70645]:       </nova:owner>
Jul 24 15:05:00 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:05:00 user nova-compute[70645]:       <nova:ports>
Jul 24 15:05:00 user nova-compute[70645]:         <nova:port uuid="5db4c40e-e5fe-4aff-82c2-33a2bc44478f">
Jul 24 15:05:00 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 15:05:00 user nova-compute[70645]:         </nova:port>
Jul 24 15:05:00 user nova-compute[70645]:       </nova:ports>
Jul 24 15:05:00 user nova-compute[70645]:     </nova:instance>
Jul 24 15:05:00 user nova-compute[70645]:   </metadata>
Jul 24 15:05:00 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:05:00 user nova-compute[70645]:     <system>
Jul 24 15:05:00 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:05:00 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:05:00 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:05:00 user nova-compute[70645]:       <entry name="serial">21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e</entry>
Jul 24 15:05:00 user nova-compute[70645]:       <entry name="uuid">21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e</entry>
Jul 24 15:05:00 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:05:00 user nova-compute[70645]:     </system>
Jul 24 15:05:00 user nova-compute[70645]:   </sysinfo>
Jul 24 15:05:00 user nova-compute[70645]:   <os>
Jul 24 15:05:00 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:05:00 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:05:00 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:05:00 user nova-compute[70645]:   </os>
Jul 24 15:05:00 user nova-compute[70645]:   <features>
Jul 24 15:05:00 user nova-compute[70645]:     <acpi/>
Jul 24 15:05:00 user nova-compute[70645]:     <apic/>
Jul 24 15:05:00 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:05:00 user nova-compute[70645]:   </features>
Jul 24 15:05:00 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:05:00 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:05:00 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:05:00 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:05:00 user nova-compute[70645]:   </clock>
Jul 24 15:05:00 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:05:00 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:05:00 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:05:00 user nova-compute[70645]:   </cpu>
Jul 24 15:05:00 user nova-compute[70645]:   <devices>
Jul 24 15:05:00 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:05:00 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:05:00 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk"/>
Jul 24 15:05:00 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:05:00 user nova-compute[70645]:     </disk>
Jul 24 15:05:00 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:05:00 user nova-compute[70645]:       <mac address="fa:16:3e:c4:77:ef"/>
Jul 24 15:05:00 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:05:00 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:05:00 user nova-compute[70645]:       <target dev="tap5db4c40e-e5"/>
Jul 24 15:05:00 user nova-compute[70645]:     </interface>
Jul 24 15:05:00 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:05:00 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/console.log" append="off"/>
Jul 24 15:05:00 user nova-compute[70645]:     </serial>
Jul 24 15:05:00 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:05:00 user nova-compute[70645]:     <video>
Jul 24 15:05:00 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:05:00 user nova-compute[70645]:     </video>
Jul 24 15:05:00 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:05:00 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:05:00 user nova-compute[70645]:     </rng>
Jul 24 15:05:00 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:05:00 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:05:00 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:05:00 user nova-compute[70645]:     </memballoon>
Jul 24 15:05:00 user nova-compute[70645]:   </devices>
Jul 24 15:05:00 user nova-compute[70645]: </domain>
Jul 24 15:05:00 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:04:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-503794527',display_name='tempest-VolumesSnapshotTestJSON-instance-503794527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-503794527',id=28,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTa4gwabuPNtKe6tm4gcamWd3VcC2VKsMuYX0Ep9APf8uGNQh4cL06TLre3rqr6NOi6LfNDyAYMPUTf68B/Q4HCtn4saVfrML/W/TLG4As3b86FvBV4JkbvpHr1XfXkaA==',key_name='tempest-keypair-205122020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2edf2107c94e1195d57905b59344fb',ramdisk_id='',reservation_id='r-u8pw8uhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1862271743',owner_user_name='tempest-VolumesSnapshotTestJSON-1862271743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:04:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cfc37f67c214e638adb1409d4db18d6',uuid=21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "address": "fa:16:3e:c4:77:ef", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db4c40e-e5", "ovs_interfaceid": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converting VIF {"id": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "address": "fa:16:3e:c4:77:ef", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db4c40e-e5", "ovs_interfaceid": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:77:ef,bridge_name='br-int',has_traffic_filtering=True,id=5db4c40e-e5fe-4aff-82c2-33a2bc44478f,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db4c40e-e5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG os_vif [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:77:ef,bridge_name='br-int',has_traffic_filtering=True,id=5db4c40e-e5fe-4aff-82c2-33a2bc44478f,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db4c40e-e5') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5db4c40e-e5, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5db4c40e-e5, col_values=(('external_ids', {'iface-id': '5db4c40e-e5fe-4aff-82c2-33a2bc44478f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:77:ef', 'vm-uuid': '21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:00 user nova-compute[70645]: INFO os_vif [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:77:ef,bridge_name='br-int',has_traffic_filtering=True,id=5db4c40e-e5fe-4aff-82c2-33a2bc44478f,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db4c40e-e5')
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:05:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] No VIF found with MAC fa:16:3e:c4:77:ef, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:05:01 user nova-compute[70645]: DEBUG nova.network.neutron [req-0491db87-e7ad-46c2-bf35-f47d89ac1fb4 req-9b5382dd-d593-4b24-9337-7267f2d0563d service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Updated VIF entry in instance network info cache for port 5db4c40e-e5fe-4aff-82c2-33a2bc44478f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:05:01 user nova-compute[70645]: DEBUG nova.network.neutron [req-0491db87-e7ad-46c2-bf35-f47d89ac1fb4 req-9b5382dd-d593-4b24-9337-7267f2d0563d service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Updating instance_info_cache with network_info: [{"id": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "address": "fa:16:3e:c4:77:ef", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db4c40e-e5", "ovs_interfaceid": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:05:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0491db87-e7ad-46c2-bf35-f47d89ac1fb4 req-9b5382dd-d593-4b24-9337-7267f2d0563d service nova] Releasing lock "refresh_cache-21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:05:01 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211086.205253, 9ea99927-77d9-4e98-b435-d4c781031d90 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:01 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] VM Stopped (Lifecycle Event)
Jul 24 15:05:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-f423f9c6-3be3-4ba2-8a10-b584b138b55e None None] [instance: 9ea99927-77d9-4e98-b435-d4c781031d90] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-63c36f1a-7714-49a0-816d-ad642f7bc2e1 req-25292a82-a18e-425d-a84c-5aeafef70b8a service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Received event network-vif-plugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-63c36f1a-7714-49a0-816d-ad642f7bc2e1 req-25292a82-a18e-425d-a84c-5aeafef70b8a service nova] Acquiring lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-63c36f1a-7714-49a0-816d-ad642f7bc2e1 req-25292a82-a18e-425d-a84c-5aeafef70b8a service nova] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-63c36f1a-7714-49a0-816d-ad642f7bc2e1 req-25292a82-a18e-425d-a84c-5aeafef70b8a service nova] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-63c36f1a-7714-49a0-816d-ad642f7bc2e1 req-25292a82-a18e-425d-a84c-5aeafef70b8a service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] No waiting events found dispatching network-vif-plugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:02 user nova-compute[70645]: WARNING nova.compute.manager [req-63c36f1a-7714-49a0-816d-ad642f7bc2e1 req-25292a82-a18e-425d-a84c-5aeafef70b8a service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Received unexpected event network-vif-plugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f for instance with vm_state building and task_state spawning.
Jul 24 15:05:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211104.2707124, 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] VM Resumed (Lifecycle Event)
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:05:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Instance spawned successfully.
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211089.2906637, 6fafa215-3ee5-4efb-816a-1d9f72e667da => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:04 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] VM Stopped (Lifecycle Event)
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8aec64a1-d7d7-46e9-acc3-175cad211fcd None None] [instance: 6fafa215-3ee5-4efb-816a-1d9f72e667da] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211104.271075, 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] VM Started (Lifecycle Event)
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:05:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:05:04 user nova-compute[70645]: INFO nova.compute.manager [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Took 5.87 seconds to spawn the instance on the hypervisor.
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-b522b022-5a95-48ec-b284-2f51279e0981 req-7f816ad1-f813-4c3f-a145-a796eff73b5e service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Received event network-vif-plugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b522b022-5a95-48ec-b284-2f51279e0981 req-7f816ad1-f813-4c3f-a145-a796eff73b5e service nova] Acquiring lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b522b022-5a95-48ec-b284-2f51279e0981 req-7f816ad1-f813-4c3f-a145-a796eff73b5e service nova] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b522b022-5a95-48ec-b284-2f51279e0981 req-7f816ad1-f813-4c3f-a145-a796eff73b5e service nova] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-b522b022-5a95-48ec-b284-2f51279e0981 req-7f816ad1-f813-4c3f-a145-a796eff73b5e service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] No waiting events found dispatching network-vif-plugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:04 user nova-compute[70645]: WARNING nova.compute.manager [req-b522b022-5a95-48ec-b284-2f51279e0981 req-7f816ad1-f813-4c3f-a145-a796eff73b5e service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Received unexpected event network-vif-plugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f for instance with vm_state building and task_state spawning.
Jul 24 15:05:04 user nova-compute[70645]: INFO nova.compute.manager [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Took 6.59 seconds to build instance.
Jul 24 15:05:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-133bce9e-8c54-4709-b2c2-0ec6dd0dd357 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.692s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "82005166-20b9-4dce-b0fe-812766f1670d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:05:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:05:09 user nova-compute[70645]: INFO nova.compute.claims [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Claim successful on node user
Jul 24 15:05:09 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:05:09 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:05:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:05:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:05:09 user nova-compute[70645]: DEBUG nova.network.neutron [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:05:09 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:05:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:05:10 user nova-compute[70645]: INFO nova.virt.block_device [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Booting with volume 698cf0df-4652-47eb-ba65-289eec42a6fc at /dev/vda
Jul 24 15:05:10 user nova-compute[70645]: DEBUG nova.policy [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43cd7067d09747f9b80cec22154a0e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863d6c0aad845139d04b550254d59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG os_brick.utils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09378fe-8c83-4265-b8e0-9143e70fae5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c14a3e-1657-4759-a9f2-fb6e952c0cf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[74652d57-7f3c-4b43-9cdd-a871361b0bde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc6d440-2664-4dd7-a271-bf8cb41a1b8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:05:10 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:05:10 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2f2653-c286-4c82-99ac-76ecc40ba821]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG os_brick.utils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating existing volume attachment record: 083bfaf9-bc57-481d-9193-842a4cc0bd54 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG nova.network.neutron [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Successfully created port: 55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:05:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG nova.network.neutron [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Successfully updated port: 55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquired lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG nova.network.neutron [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG nova.compute.manager [req-230c6bdb-8d31-44de-a019-0340159d9b21 req-8db33fee-4af8-471a-847a-d70cd9100d66 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-changed-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG nova.compute.manager [req-230c6bdb-8d31-44de-a019-0340159d9b21 req-8db33fee-4af8-471a-847a-d70cd9100d66 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Refreshing instance network info cache due to event network-changed-55ec9ae6-b6b7-4768-96b8-fe5fafed148f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-230c6bdb-8d31-44de-a019-0340159d9b21 req-8db33fee-4af8-471a-847a-d70cd9100d66 service nova] Acquiring lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG nova.network.neutron [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG nova.network.neutron [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating instance_info_cache with network_info: [{"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Releasing lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Instance network_info: |[{"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-230c6bdb-8d31-44de-a019-0340159d9b21 req-8db33fee-4af8-471a-847a-d70cd9100d66 service nova] Acquired lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:05:11 user nova-compute[70645]: DEBUG nova.network.neutron [req-230c6bdb-8d31-44de-a019-0340159d9b21 req-8db33fee-4af8-471a-847a-d70cd9100d66 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Refreshing network info cache for port 55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:05:12 user nova-compute[70645]: DEBUG nova.network.neutron [req-230c6bdb-8d31-44de-a019-0340159d9b21 req-8db33fee-4af8-471a-847a-d70cd9100d66 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updated VIF entry in instance network info cache for port 55ec9ae6-b6b7-4768-96b8-fe5fafed148f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:05:12 user nova-compute[70645]: DEBUG nova.network.neutron [req-230c6bdb-8d31-44de-a019-0340159d9b21 req-8db33fee-4af8-471a-847a-d70cd9100d66 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating instance_info_cache with network_info: [{"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:05:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-230c6bdb-8d31-44de-a019-0340159d9b21 req-8db33fee-4af8-471a-847a-d70cd9100d66 service nova] Releasing lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:05:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:05:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:05:16 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Creating image(s)
Jul 24 15:05:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 15:05:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Ensure instance console log exists: /opt/stack/data/nova/instances/82005166-20b9-4dce-b0fe-812766f1670d/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:05:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Start _get_guest_xml network_info=[{"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '083bfaf9-bc57-481d-9193-842a4cc0bd54', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXEtuKaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82005166-20b9-4dce-b0fe-812766f1670d', 'attached_at': '', 'detached_at': '', 'volume_id': '698cf0df-4652-47eb-ba65-289eec42a6fc', 'serial': '698cf0df-4652-47eb-ba65-289eec42a6fc'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:05:17 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:17 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXEtuKaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:05:17 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:05:17 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:05:17 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e53f45a-5bc2-4305-8f86-be92c9410096]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:05:17 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d9b704-6a52-48b8-b15b-ebae96708ea1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc] added
Jul 24 15:05:17 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[449ac815-a4d3-4826-ba58-3b7db1a6d0b4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[937b1339-7641-4d0b-aeac-8cde64fc9e36]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXEtuKaW {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXEtuKaW" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa31dd7-e2cf-4c81-bce2-aa44c96eaac4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QXEtuKaW'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[190189fa-fb04-4bea-8ab7-26aa8699965d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[44858afd-64e8-4630-a94e-46c158a82373]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:05:17 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:05:17 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:05:17 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:05:17 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a25821-84f3-4ce7-b561-9b567fff8348]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260]
Jul 24 15:05:17 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260] successful.
Jul 24 15:05:17 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58762dc-a1cc-4385-8228-accb7796aaa4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c0fa69-e424-4f25-a182-4e83c9e0f4de]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:05:17 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:05:17 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:05:17 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:05:17 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:05:17 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:05:17 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1da3f78-eb8d-45b7-a974-7f40e76148b4]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:05:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXEtuKaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26466643639633734', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466643639633734', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1826590044',display_name='tempest-ServerActionsTestOtherA-server-1826590044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1826590044',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-dqgn0mql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:05:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=82005166-20b9-4dce-b0fe-812766f1670d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG nova.objects.instance [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'pci_devices' on Instance uuid 82005166-20b9-4dce-b0fe-812766f1670d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:05:18 user nova-compute[70645]:   <uuid>82005166-20b9-4dce-b0fe-812766f1670d</uuid>
Jul 24 15:05:18 user nova-compute[70645]:   <name>instance-0000001d</name>
Jul 24 15:05:18 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:05:18 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:05:18 user nova-compute[70645]:   <metadata>
Jul 24 15:05:18 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:05:18 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:05:18 user nova-compute[70645]:       <nova:name>tempest-ServerActionsTestOtherA-server-1826590044</nova:name>
Jul 24 15:05:18 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:05:17</nova:creationTime>
Jul 24 15:05:18 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:05:18 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:05:18 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:05:18 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:05:18 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:05:18 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:05:18 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:05:18 user nova-compute[70645]:       <nova:owner>
Jul 24 15:05:18 user nova-compute[70645]:         <nova:user uuid="43cd7067d09747f9b80cec22154a0e93">tempest-ServerActionsTestOtherA-1886739574-project-member</nova:user>
Jul 24 15:05:18 user nova-compute[70645]:         <nova:project uuid="f863d6c0aad845139d04b550254d59e3">tempest-ServerActionsTestOtherA-1886739574</nova:project>
Jul 24 15:05:18 user nova-compute[70645]:       </nova:owner>
Jul 24 15:05:18 user nova-compute[70645]:       <nova:ports>
Jul 24 15:05:18 user nova-compute[70645]:         <nova:port uuid="55ec9ae6-b6b7-4768-96b8-fe5fafed148f">
Jul 24 15:05:18 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 15:05:18 user nova-compute[70645]:         </nova:port>
Jul 24 15:05:18 user nova-compute[70645]:       </nova:ports>
Jul 24 15:05:18 user nova-compute[70645]:     </nova:instance>
Jul 24 15:05:18 user nova-compute[70645]:   </metadata>
Jul 24 15:05:18 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:05:18 user nova-compute[70645]:     <system>
Jul 24 15:05:18 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:05:18 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:05:18 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:05:18 user nova-compute[70645]:       <entry name="serial">82005166-20b9-4dce-b0fe-812766f1670d</entry>
Jul 24 15:05:18 user nova-compute[70645]:       <entry name="uuid">82005166-20b9-4dce-b0fe-812766f1670d</entry>
Jul 24 15:05:18 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:05:18 user nova-compute[70645]:     </system>
Jul 24 15:05:18 user nova-compute[70645]:   </sysinfo>
Jul 24 15:05:18 user nova-compute[70645]:   <os>
Jul 24 15:05:18 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:05:18 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:05:18 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:05:18 user nova-compute[70645]:   </os>
Jul 24 15:05:18 user nova-compute[70645]:   <features>
Jul 24 15:05:18 user nova-compute[70645]:     <acpi/>
Jul 24 15:05:18 user nova-compute[70645]:     <apic/>
Jul 24 15:05:18 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:05:18 user nova-compute[70645]:   </features>
Jul 24 15:05:18 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:05:18 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:05:18 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:05:18 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:05:18 user nova-compute[70645]:   </clock>
Jul 24 15:05:18 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:05:18 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:05:18 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:05:18 user nova-compute[70645]:   </cpu>
Jul 24 15:05:18 user nova-compute[70645]:   <devices>
Jul 24 15:05:18 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:05:18 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:05:18 user nova-compute[70645]:       <source dev="/dev/sdb"/>
Jul 24 15:05:18 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:05:18 user nova-compute[70645]:       <serial>698cf0df-4652-47eb-ba65-289eec42a6fc</serial>
Jul 24 15:05:18 user nova-compute[70645]:     </disk>
Jul 24 15:05:18 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:05:18 user nova-compute[70645]:       <mac address="fa:16:3e:d8:fb:57"/>
Jul 24 15:05:18 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:05:18 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:05:18 user nova-compute[70645]:       <target dev="tap55ec9ae6-b6"/>
Jul 24 15:05:18 user nova-compute[70645]:     </interface>
Jul 24 15:05:18 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:05:18 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/82005166-20b9-4dce-b0fe-812766f1670d/console.log" append="off"/>
Jul 24 15:05:18 user nova-compute[70645]:     </serial>
Jul 24 15:05:18 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:05:18 user nova-compute[70645]:     <video>
Jul 24 15:05:18 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:05:18 user nova-compute[70645]:     </video>
Jul 24 15:05:18 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:05:18 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:05:18 user nova-compute[70645]:     </rng>
Jul 24 15:05:18 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:05:18 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:05:18 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:05:18 user nova-compute[70645]:     </memballoon>
Jul 24 15:05:18 user nova-compute[70645]:   </devices>
Jul 24 15:05:18 user nova-compute[70645]: </domain>
Jul 24 15:05:18 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1826590044',display_name='tempest-ServerActionsTestOtherA-server-1826590044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1826590044',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-dqgn0mql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:05:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=82005166-20b9-4dce-b0fe-812766f1670d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG os_vif [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55ec9ae6-b6, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55ec9ae6-b6, col_values=(('external_ids', {'iface-id': '55ec9ae6-b6b7-4768-96b8-fe5fafed148f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:fb:57', 'vm-uuid': '82005166-20b9-4dce-b0fe-812766f1670d'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:18 user nova-compute[70645]: INFO os_vif [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6')
Jul 24 15:05:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:05:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No VIF found with MAC fa:16:3e:d8:fb:57, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:05:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-e25797ca-a572-499d-9e0a-bafd784de541 req-57a85718-7269-47e4-9df3-c98b4a1011b7 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e25797ca-a572-499d-9e0a-bafd784de541 req-57a85718-7269-47e4-9df3-c98b4a1011b7 service nova] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e25797ca-a572-499d-9e0a-bafd784de541 req-57a85718-7269-47e4-9df3-c98b4a1011b7 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e25797ca-a572-499d-9e0a-bafd784de541 req-57a85718-7269-47e4-9df3-c98b4a1011b7 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-e25797ca-a572-499d-9e0a-bafd784de541 req-57a85718-7269-47e4-9df3-c98b4a1011b7 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] No waiting events found dispatching network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:20 user nova-compute[70645]: WARNING nova.compute.manager [req-e25797ca-a572-499d-9e0a-bafd784de541 req-57a85718-7269-47e4-9df3-c98b4a1011b7 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received unexpected event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f for instance with vm_state building and task_state spawning.
Jul 24 15:05:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:05:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:20 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-151840fe-0c5b-41ba-b25b-1867396ffb8d req-a5d21261-1c75-4e9b-b023-a3a00e6015e7 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-151840fe-0c5b-41ba-b25b-1867396ffb8d req-a5d21261-1c75-4e9b-b023-a3a00e6015e7 service nova] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-151840fe-0c5b-41ba-b25b-1867396ffb8d req-a5d21261-1c75-4e9b-b023-a3a00e6015e7 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-151840fe-0c5b-41ba-b25b-1867396ffb8d req-a5d21261-1c75-4e9b-b023-a3a00e6015e7 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-151840fe-0c5b-41ba-b25b-1867396ffb8d req-a5d21261-1c75-4e9b-b023-a3a00e6015e7 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] No waiting events found dispatching network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:22 user nova-compute[70645]: WARNING nova.compute.manager [req-151840fe-0c5b-41ba-b25b-1867396ffb8d req-a5d21261-1c75-4e9b-b023-a3a00e6015e7 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received unexpected event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f for instance with vm_state building and task_state spawning.
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211122.1957014, 82005166-20b9-4dce-b0fe-812766f1670d => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:22 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] VM Resumed (Lifecycle Event)
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:22 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Instance spawned successfully.
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:22 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211122.1971529, 82005166-20b9-4dce-b0fe-812766f1670d => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:22 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] VM Started (Lifecycle Event)
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:05:22 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:05:22 user nova-compute[70645]: INFO nova.compute.manager [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Took 5.47 seconds to spawn the instance on the hypervisor.
Jul 24 15:05:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:22 user nova-compute[70645]: INFO nova.compute.manager [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Took 13.26 seconds to build instance.
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-45ea00cb-7ad6-4061-8701-9ee091941f4a tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "82005166-20b9-4dce-b0fe-812766f1670d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.373s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:22 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:05:24 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:24 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7569MB free_disk=25.379009246826172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 734abf9a-96dd-40b4-9b68-2d42fa079216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 07adce07-b416-44fb-b548-17b8cd0d8168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 8ad33774-2d1b-480d-871d-f422c941c806 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 4f686b79-b22d-4453-ae35-7a1133d7aa86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 82005166-20b9-4dce-b0fe-812766f1670d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:05:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:05:25 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:05:25 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:05:25 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:05:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:26 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:05:26 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:05:26 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:05:26 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:05:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:05:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:26 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:05:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:05:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 15:05:26 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:05:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:27 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:05:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:29 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:05:30 user nova-compute[70645]: INFO nova.compute.claims [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Claim successful on node user
Jul 24 15:05:30 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:05:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:05:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG nova.policy [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7baae1cced074129abc9c7e46a69001e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2a4081bd346928d0e316e7e856479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:05:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:05:31 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Creating image(s)
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "/opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "/opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk 1073741824" returned: 0 in 0.051s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Successfully created port: a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Cannot resize image /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lazy-loading 'migration_context' on Instance uuid 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Ensure instance console log exists: /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Successfully updated port: a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "refresh_cache-5bc347f4-5487-4e88-96d5-9b2f411cb1e4" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquired lock "refresh_cache-5bc347f4-5487-4e88-96d5-9b2f411cb1e4" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-43f70b9e-bfd5-4eba-aff8-36a1f55a06d4 req-515350b4-6c95-439e-95a1-71a9885925b2 service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Received event network-changed-a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-43f70b9e-bfd5-4eba-aff8-36a1f55a06d4 req-515350b4-6c95-439e-95a1-71a9885925b2 service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Refreshing instance network info cache due to event network-changed-a605a24e-447e-4dac-af86-14d665fa2391. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-43f70b9e-bfd5-4eba-aff8-36a1f55a06d4 req-515350b4-6c95-439e-95a1-71a9885925b2 service nova] Acquiring lock "refresh_cache-5bc347f4-5487-4e88-96d5-9b2f411cb1e4" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Updating instance_info_cache with network_info: [{"id": "a605a24e-447e-4dac-af86-14d665fa2391", "address": "fa:16:3e:e3:ce:5e", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa605a24e-44", "ovs_interfaceid": "a605a24e-447e-4dac-af86-14d665fa2391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Releasing lock "refresh_cache-5bc347f4-5487-4e88-96d5-9b2f411cb1e4" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Instance network_info: |[{"id": "a605a24e-447e-4dac-af86-14d665fa2391", "address": "fa:16:3e:e3:ce:5e", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa605a24e-44", "ovs_interfaceid": "a605a24e-447e-4dac-af86-14d665fa2391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-43f70b9e-bfd5-4eba-aff8-36a1f55a06d4 req-515350b4-6c95-439e-95a1-71a9885925b2 service nova] Acquired lock "refresh_cache-5bc347f4-5487-4e88-96d5-9b2f411cb1e4" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.network.neutron [req-43f70b9e-bfd5-4eba-aff8-36a1f55a06d4 req-515350b4-6c95-439e-95a1-71a9885925b2 service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Refreshing network info cache for port a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Start _get_guest_xml network_info=[{"id": "a605a24e-447e-4dac-af86-14d665fa2391", "address": "fa:16:3e:e3:ce:5e", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa605a24e-44", "ovs_interfaceid": "a605a24e-447e-4dac-af86-14d665fa2391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:05:32 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:32 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-784477117',display_name='tempest-ServersNegativeTestJSON-server-784477117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-784477117',id=30,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3f2a4081bd346928d0e316e7e856479',ramdisk_id='',reservation_id='r-wzp30pfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-118608074',owner_user_name='tempest-ServersNegativeTestJSON-118608074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:05:31Z,user_data=None,user_id='7baae1cced074129abc9c7e46a69001e',uuid=5bc347f4-5487-4e88-96d5-9b2f411cb1e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a605a24e-447e-4dac-af86-14d665fa2391", "address": "fa:16:3e:e3:ce:5e", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa605a24e-44", "ovs_interfaceid": "a605a24e-447e-4dac-af86-14d665fa2391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converting VIF {"id": "a605a24e-447e-4dac-af86-14d665fa2391", "address": "fa:16:3e:e3:ce:5e", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa605a24e-44", "ovs_interfaceid": "a605a24e-447e-4dac-af86-14d665fa2391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ce:5e,bridge_name='br-int',has_traffic_filtering=True,id=a605a24e-447e-4dac-af86-14d665fa2391,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa605a24e-44') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:05:32 user nova-compute[70645]:   <uuid>5bc347f4-5487-4e88-96d5-9b2f411cb1e4</uuid>
Jul 24 15:05:32 user nova-compute[70645]:   <name>instance-0000001e</name>
Jul 24 15:05:32 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:05:32 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:05:32 user nova-compute[70645]:   <metadata>
Jul 24 15:05:32 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:05:32 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:05:32 user nova-compute[70645]:       <nova:name>tempest-ServersNegativeTestJSON-server-784477117</nova:name>
Jul 24 15:05:32 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:05:32</nova:creationTime>
Jul 24 15:05:32 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:05:32 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:05:32 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:05:32 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:05:32 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:05:32 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:05:32 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:05:32 user nova-compute[70645]:       <nova:owner>
Jul 24 15:05:32 user nova-compute[70645]:         <nova:user uuid="7baae1cced074129abc9c7e46a69001e">tempest-ServersNegativeTestJSON-118608074-project-member</nova:user>
Jul 24 15:05:32 user nova-compute[70645]:         <nova:project uuid="e3f2a4081bd346928d0e316e7e856479">tempest-ServersNegativeTestJSON-118608074</nova:project>
Jul 24 15:05:32 user nova-compute[70645]:       </nova:owner>
Jul 24 15:05:32 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:05:32 user nova-compute[70645]:       <nova:ports>
Jul 24 15:05:32 user nova-compute[70645]:         <nova:port uuid="a605a24e-447e-4dac-af86-14d665fa2391">
Jul 24 15:05:32 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 15:05:32 user nova-compute[70645]:         </nova:port>
Jul 24 15:05:32 user nova-compute[70645]:       </nova:ports>
Jul 24 15:05:32 user nova-compute[70645]:     </nova:instance>
Jul 24 15:05:32 user nova-compute[70645]:   </metadata>
Jul 24 15:05:32 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:05:32 user nova-compute[70645]:     <system>
Jul 24 15:05:32 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:05:32 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:05:32 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:05:32 user nova-compute[70645]:       <entry name="serial">5bc347f4-5487-4e88-96d5-9b2f411cb1e4</entry>
Jul 24 15:05:32 user nova-compute[70645]:       <entry name="uuid">5bc347f4-5487-4e88-96d5-9b2f411cb1e4</entry>
Jul 24 15:05:32 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:05:32 user nova-compute[70645]:     </system>
Jul 24 15:05:32 user nova-compute[70645]:   </sysinfo>
Jul 24 15:05:32 user nova-compute[70645]:   <os>
Jul 24 15:05:32 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:05:32 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:05:32 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:05:32 user nova-compute[70645]:   </os>
Jul 24 15:05:32 user nova-compute[70645]:   <features>
Jul 24 15:05:32 user nova-compute[70645]:     <acpi/>
Jul 24 15:05:32 user nova-compute[70645]:     <apic/>
Jul 24 15:05:32 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:05:32 user nova-compute[70645]:   </features>
Jul 24 15:05:32 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:05:32 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:05:32 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:05:32 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:05:32 user nova-compute[70645]:   </clock>
Jul 24 15:05:32 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:05:32 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:05:32 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:05:32 user nova-compute[70645]:   </cpu>
Jul 24 15:05:32 user nova-compute[70645]:   <devices>
Jul 24 15:05:32 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:05:32 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:05:32 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk"/>
Jul 24 15:05:32 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:05:32 user nova-compute[70645]:     </disk>
Jul 24 15:05:32 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:05:32 user nova-compute[70645]:       <mac address="fa:16:3e:e3:ce:5e"/>
Jul 24 15:05:32 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:05:32 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:05:32 user nova-compute[70645]:       <target dev="tapa605a24e-44"/>
Jul 24 15:05:32 user nova-compute[70645]:     </interface>
Jul 24 15:05:32 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:05:32 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/console.log" append="off"/>
Jul 24 15:05:32 user nova-compute[70645]:     </serial>
Jul 24 15:05:32 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:05:32 user nova-compute[70645]:     <video>
Jul 24 15:05:32 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:05:32 user nova-compute[70645]:     </video>
Jul 24 15:05:32 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:05:32 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:05:32 user nova-compute[70645]:     </rng>
Jul 24 15:05:32 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:05:32 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:05:32 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:05:32 user nova-compute[70645]:     </memballoon>
Jul 24 15:05:32 user nova-compute[70645]:   </devices>
Jul 24 15:05:32 user nova-compute[70645]: </domain>
Jul 24 15:05:32 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-784477117',display_name='tempest-ServersNegativeTestJSON-server-784477117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-784477117',id=30,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3f2a4081bd346928d0e316e7e856479',ramdisk_id='',reservation_id='r-wzp30pfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-118608074',owner_user_name='tempest-ServersNegativeTestJSON-118608074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:05:31Z,user_data=None,user_id='7baae1cced074129abc9c7e46a69001e',uuid=5bc347f4-5487-4e88-96d5-9b2f411cb1e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a605a24e-447e-4dac-af86-14d665fa2391", "address": "fa:16:3e:e3:ce:5e", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa605a24e-44", "ovs_interfaceid": "a605a24e-447e-4dac-af86-14d665fa2391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converting VIF {"id": "a605a24e-447e-4dac-af86-14d665fa2391", "address": "fa:16:3e:e3:ce:5e", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa605a24e-44", "ovs_interfaceid": "a605a24e-447e-4dac-af86-14d665fa2391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ce:5e,bridge_name='br-int',has_traffic_filtering=True,id=a605a24e-447e-4dac-af86-14d665fa2391,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa605a24e-44') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG os_vif [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ce:5e,bridge_name='br-int',has_traffic_filtering=True,id=a605a24e-447e-4dac-af86-14d665fa2391,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa605a24e-44') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa605a24e-44, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa605a24e-44, col_values=(('external_ids', {'iface-id': 'a605a24e-447e-4dac-af86-14d665fa2391', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:ce:5e', 'vm-uuid': '5bc347f4-5487-4e88-96d5-9b2f411cb1e4'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:32 user nova-compute[70645]: INFO os_vif [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ce:5e,bridge_name='br-int',has_traffic_filtering=True,id=a605a24e-447e-4dac-af86-14d665fa2391,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa605a24e-44')
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:05:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] No VIF found with MAC fa:16:3e:e3:ce:5e, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:05:33 user nova-compute[70645]: DEBUG nova.network.neutron [req-43f70b9e-bfd5-4eba-aff8-36a1f55a06d4 req-515350b4-6c95-439e-95a1-71a9885925b2 service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Updated VIF entry in instance network info cache for port a605a24e-447e-4dac-af86-14d665fa2391. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:05:33 user nova-compute[70645]: DEBUG nova.network.neutron [req-43f70b9e-bfd5-4eba-aff8-36a1f55a06d4 req-515350b4-6c95-439e-95a1-71a9885925b2 service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Updating instance_info_cache with network_info: [{"id": "a605a24e-447e-4dac-af86-14d665fa2391", "address": "fa:16:3e:e3:ce:5e", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa605a24e-44", "ovs_interfaceid": "a605a24e-447e-4dac-af86-14d665fa2391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:05:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-43f70b9e-bfd5-4eba-aff8-36a1f55a06d4 req-515350b4-6c95-439e-95a1-71a9885925b2 service nova] Releasing lock "refresh_cache-5bc347f4-5487-4e88-96d5-9b2f411cb1e4" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-f9e16835-df5c-43d5-8daf-46bb73bdc4bd req-31a7c67d-1235-4f22-8af4-d3ec5621805e service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Received event network-vif-plugged-a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f9e16835-df5c-43d5-8daf-46bb73bdc4bd req-31a7c67d-1235-4f22-8af4-d3ec5621805e service nova] Acquiring lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f9e16835-df5c-43d5-8daf-46bb73bdc4bd req-31a7c67d-1235-4f22-8af4-d3ec5621805e service nova] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f9e16835-df5c-43d5-8daf-46bb73bdc4bd req-31a7c67d-1235-4f22-8af4-d3ec5621805e service nova] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-f9e16835-df5c-43d5-8daf-46bb73bdc4bd req-31a7c67d-1235-4f22-8af4-d3ec5621805e service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] No waiting events found dispatching network-vif-plugged-a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:34 user nova-compute[70645]: WARNING nova.compute.manager [req-f9e16835-df5c-43d5-8daf-46bb73bdc4bd req-31a7c67d-1235-4f22-8af4-d3ec5621805e service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Received unexpected event network-vif-plugged-a605a24e-447e-4dac-af86-14d665fa2391 for instance with vm_state building and task_state spawning.
Jul 24 15:05:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211136.376285, 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] VM Resumed (Lifecycle Event)
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:05:36 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Instance spawned successfully.
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211136.3765728, 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] VM Started (Lifecycle Event)
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-ac5040ba-1438-4738-8d79-0cee295378c1 req-6684487f-a148-4521-a485-cb059c80b760 service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Received event network-vif-plugged-a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ac5040ba-1438-4738-8d79-0cee295378c1 req-6684487f-a148-4521-a485-cb059c80b760 service nova] Acquiring lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ac5040ba-1438-4738-8d79-0cee295378c1 req-6684487f-a148-4521-a485-cb059c80b760 service nova] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ac5040ba-1438-4738-8d79-0cee295378c1 req-6684487f-a148-4521-a485-cb059c80b760 service nova] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-ac5040ba-1438-4738-8d79-0cee295378c1 req-6684487f-a148-4521-a485-cb059c80b760 service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] No waiting events found dispatching network-vif-plugged-a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:36 user nova-compute[70645]: WARNING nova.compute.manager [req-ac5040ba-1438-4738-8d79-0cee295378c1 req-6684487f-a148-4521-a485-cb059c80b760 service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Received unexpected event network-vif-plugged-a605a24e-447e-4dac-af86-14d665fa2391 for instance with vm_state building and task_state spawning.
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:05:36 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:05:36 user nova-compute[70645]: INFO nova.compute.manager [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Took 5.51 seconds to spawn the instance on the hypervisor.
Jul 24 15:05:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:36 user nova-compute[70645]: INFO nova.compute.manager [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Took 6.32 seconds to build instance.
Jul 24 15:05:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c3937bda-f09f-4f1f-8810-184d72fd82aa tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.493s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-8b8c8e8a-3426-46a3-ada8-e8def0828b8f req-3f44e477-1c51-4c96-8649-e755717420f1 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Received event network-changed-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-8b8c8e8a-3426-46a3-ada8-e8def0828b8f req-3f44e477-1c51-4c96-8649-e755717420f1 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Refreshing instance network info cache due to event network-changed-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:05:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8b8c8e8a-3426-46a3-ada8-e8def0828b8f req-3f44e477-1c51-4c96-8649-e755717420f1 service nova] Acquiring lock "refresh_cache-8ad33774-2d1b-480d-871d-f422c941c806" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:05:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8b8c8e8a-3426-46a3-ada8-e8def0828b8f req-3f44e477-1c51-4c96-8649-e755717420f1 service nova] Acquired lock "refresh_cache-8ad33774-2d1b-480d-871d-f422c941c806" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:05:39 user nova-compute[70645]: DEBUG nova.network.neutron [req-8b8c8e8a-3426-46a3-ada8-e8def0828b8f req-3f44e477-1c51-4c96-8649-e755717420f1 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Refreshing network info cache for port b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:05:40 user nova-compute[70645]: DEBUG nova.network.neutron [req-8b8c8e8a-3426-46a3-ada8-e8def0828b8f req-3f44e477-1c51-4c96-8649-e755717420f1 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Updated VIF entry in instance network info cache for port b65f6c0a-8af9-451a-a64b-bfc1f9b4a504. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:05:40 user nova-compute[70645]: DEBUG nova.network.neutron [req-8b8c8e8a-3426-46a3-ada8-e8def0828b8f req-3f44e477-1c51-4c96-8649-e755717420f1 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Updating instance_info_cache with network_info: [{"id": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "address": "fa:16:3e:e3:de:db", "network": {"id": "c10d23da-ee3b-45ad-b6d7-cbee6fe26734", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2122699067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aea075d521479db680d0553e30f0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65f6c0a-8a", "ovs_interfaceid": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:05:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8b8c8e8a-3426-46a3-ada8-e8def0828b8f req-3f44e477-1c51-4c96-8649-e755717420f1 service nova] Releasing lock "refresh_cache-8ad33774-2d1b-480d-871d-f422c941c806" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:05:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:40 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:05:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:40 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:05:40 user nova-compute[70645]: INFO nova.compute.claims [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Claim successful on node user
Jul 24 15:05:41 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG nova.network.neutron [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:05:41 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:05:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG nova.policy [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9ba00b9477d416ba510bf66b424c1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d01222b2028429fae08bb542e5cd9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:05:41 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Creating image(s)
Jul 24 15:05:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "/opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "/opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "/opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.152s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.196s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk 1073741824" returned: 0 in 0.062s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.152s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG nova.network.neutron [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Successfully created port: 65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Cannot resize image /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'migration_context' on Instance uuid 50dc20e7-65ef-4743-8707-9ef7da98f947 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Ensure instance console log exists: /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:42 user nova-compute[70645]: INFO nova.compute.manager [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Rescuing
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquired lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG nova.network.neutron [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:05:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Updating instance_info_cache with network_info: [{"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Releasing lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG nova.objects.instance [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lazy-loading 'flavor' on Instance uuid 8ad33774-2d1b-480d-871d-f422c941c806 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Successfully updated port: 65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquired lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-1b718a65-777f-4980-91a9-232875ab220b req-9c98d7f8-848a-43c7-a57c-069862320a8d service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-changed-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-1b718a65-777f-4980-91a9-232875ab220b req-9c98d7f8-848a-43c7-a57c-069862320a8d service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Refreshing instance network info cache due to event network-changed-65f3b461-6fb6-4333-a140-5935cdbed714. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1b718a65-777f-4980-91a9-232875ab220b req-9c98d7f8-848a-43c7-a57c-069862320a8d service nova] Acquiring lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:43 user nova-compute[70645]: INFO nova.compute.manager [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Attaching volume 087aa622-8e57-46e5-bd74-fae2d812a9c4 to /dev/vdb
Jul 24 15:05:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG os_brick.utils [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:43 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Instance destroyed successfully.
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d3de00-1e5c-44f3-be38-2ebc0148904d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:43 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Attempting a stable device rescue
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3b9066-3ad2-4015-8fbf-1fe306193806]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa299c3b-8b0b-48b3-8f14-50751850889a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd727ff8-798c-4166-8d40-d942b1cb7840]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70645) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Instance directory exists: not creating {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 15:05:44 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Creating image(s)
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "/opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "/opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG nova.objects.instance [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f686b79-b22d-4453-ae35-7a1133d7aa86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:05:44 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b4f060-4a04-4327-9606-b386b1b60b52]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG os_brick.utils [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Updating existing volume attachment record: 448a2bcb-c27d-4939-9581-43d6ab00a457 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "22a8ff649151c19c1cd129ff081975377d81863e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "22a8ff649151c19c1cd129ff081975377d81863e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e.part --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.network.neutron [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updating instance_info_cache with network_info: [{"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Releasing lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Instance network_info: |[{"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1b718a65-777f-4980-91a9-232875ab220b req-9c98d7f8-848a-43c7-a57c-069862320a8d service nova] Acquired lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-1b718a65-777f-4980-91a9-232875ab220b req-9c98d7f8-848a-43c7-a57c-069862320a8d service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Refreshing network info cache for port 65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Start _get_guest_xml network_info=[{"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:05:45 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:45 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330489753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330489753',id=31,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaXAroQ4BdTvsI0tcXXaibpJpjFI70qBUNCYaWNBQ2yL3snJ4LkWJiVjr8FxamHsO0VuKXioe3d0VYrb0hT4AInm7bicj8DShVjS8c3e60SA9BG30+FFh/DCXsUzU+fDA==',key_name='tempest-keypair-1407958414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-h40p6unj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=50dc20e7-65ef-4743-8707-9ef7da98f947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'pci_devices' on Instance uuid 50dc20e7-65ef-4743-8707-9ef7da98f947 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e.part --force-share --output=json" returned: 0 in 0.185s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.images [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] d05b7cf3-dd7f-409e-93ac-7ab208aa5d7e was qcow2, converting to raw {{(pid=70645) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e.part /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e.converted {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:05:45 user nova-compute[70645]:   <uuid>50dc20e7-65ef-4743-8707-9ef7da98f947</uuid>
Jul 24 15:05:45 user nova-compute[70645]:   <name>instance-0000001f</name>
Jul 24 15:05:45 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:05:45 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:05:45 user nova-compute[70645]:   <metadata>
Jul 24 15:05:45 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:05:45 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:05:45 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1330489753</nova:name>
Jul 24 15:05:45 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:05:45</nova:creationTime>
Jul 24 15:05:45 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:05:45 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:05:45 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:05:45 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:05:45 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:05:45 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:05:45 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:05:45 user nova-compute[70645]:       <nova:owner>
Jul 24 15:05:45 user nova-compute[70645]:         <nova:user uuid="d9ba00b9477d416ba510bf66b424c1f9">tempest-AttachVolumeShelveTestJSON-218162714-project-member</nova:user>
Jul 24 15:05:45 user nova-compute[70645]:         <nova:project uuid="5d01222b2028429fae08bb542e5cd9cc">tempest-AttachVolumeShelveTestJSON-218162714</nova:project>
Jul 24 15:05:45 user nova-compute[70645]:       </nova:owner>
Jul 24 15:05:45 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:05:45 user nova-compute[70645]:       <nova:ports>
Jul 24 15:05:45 user nova-compute[70645]:         <nova:port uuid="65f3b461-6fb6-4333-a140-5935cdbed714">
Jul 24 15:05:45 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 15:05:45 user nova-compute[70645]:         </nova:port>
Jul 24 15:05:45 user nova-compute[70645]:       </nova:ports>
Jul 24 15:05:45 user nova-compute[70645]:     </nova:instance>
Jul 24 15:05:45 user nova-compute[70645]:   </metadata>
Jul 24 15:05:45 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:05:45 user nova-compute[70645]:     <system>
Jul 24 15:05:45 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:05:45 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:05:45 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:05:45 user nova-compute[70645]:       <entry name="serial">50dc20e7-65ef-4743-8707-9ef7da98f947</entry>
Jul 24 15:05:45 user nova-compute[70645]:       <entry name="uuid">50dc20e7-65ef-4743-8707-9ef7da98f947</entry>
Jul 24 15:05:45 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:05:45 user nova-compute[70645]:     </system>
Jul 24 15:05:45 user nova-compute[70645]:   </sysinfo>
Jul 24 15:05:45 user nova-compute[70645]:   <os>
Jul 24 15:05:45 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:05:45 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:05:45 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:05:45 user nova-compute[70645]:   </os>
Jul 24 15:05:45 user nova-compute[70645]:   <features>
Jul 24 15:05:45 user nova-compute[70645]:     <acpi/>
Jul 24 15:05:45 user nova-compute[70645]:     <apic/>
Jul 24 15:05:45 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:05:45 user nova-compute[70645]:   </features>
Jul 24 15:05:45 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:05:45 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:05:45 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:05:45 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:05:45 user nova-compute[70645]:   </clock>
Jul 24 15:05:45 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:05:45 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:05:45 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:05:45 user nova-compute[70645]:   </cpu>
Jul 24 15:05:45 user nova-compute[70645]:   <devices>
Jul 24 15:05:45 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:05:45 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:05:45 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk"/>
Jul 24 15:05:45 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:05:45 user nova-compute[70645]:     </disk>
Jul 24 15:05:45 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:05:45 user nova-compute[70645]:       <mac address="fa:16:3e:48:b6:04"/>
Jul 24 15:05:45 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:05:45 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:05:45 user nova-compute[70645]:       <target dev="tap65f3b461-6f"/>
Jul 24 15:05:45 user nova-compute[70645]:     </interface>
Jul 24 15:05:45 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:05:45 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/console.log" append="off"/>
Jul 24 15:05:45 user nova-compute[70645]:     </serial>
Jul 24 15:05:45 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:05:45 user nova-compute[70645]:     <video>
Jul 24 15:05:45 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:05:45 user nova-compute[70645]:     </video>
Jul 24 15:05:45 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:05:45 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:05:45 user nova-compute[70645]:     </rng>
Jul 24 15:05:45 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:05:45 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:05:45 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:05:45 user nova-compute[70645]:     </memballoon>
Jul 24 15:05:45 user nova-compute[70645]:   </devices>
Jul 24 15:05:45 user nova-compute[70645]: </domain>
Jul 24 15:05:45 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330489753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330489753',id=31,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaXAroQ4BdTvsI0tcXXaibpJpjFI70qBUNCYaWNBQ2yL3snJ4LkWJiVjr8FxamHsO0VuKXioe3d0VYrb0hT4AInm7bicj8DShVjS8c3e60SA9BG30+FFh/DCXsUzU+fDA==',key_name='tempest-keypair-1407958414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-h40p6unj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=50dc20e7-65ef-4743-8707-9ef7da98f947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG os_vif [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65f3b461-6f, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65f3b461-6f, col_values=(('external_ids', {'iface-id': '65f3b461-6fb6-4333-a140-5935cdbed714', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:b6:04', 'vm-uuid': '50dc20e7-65ef-4743-8707-9ef7da98f947'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-unplugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-unplugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:45 user nova-compute[70645]: WARNING nova.compute.manager [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received unexpected event network-vif-unplugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with vm_state active and task_state rescuing.
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:45 user nova-compute[70645]: WARNING nova.compute.manager [req-47c9f596-3d95-44d8-9dcf-99601771d563 req-ceaf5d34-1123-4e9e-8cd8-7d1a1c2b5717 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received unexpected event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with vm_state active and task_state rescuing.
Jul 24 15:05:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:45 user nova-compute[70645]: INFO os_vif [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f')
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] No VIF found with MAC fa:16:3e:48:b6:04, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.network.neutron [req-1b718a65-777f-4980-91a9-232875ab220b req-9c98d7f8-848a-43c7-a57c-069862320a8d service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updated VIF entry in instance network info cache for port 65f3b461-6fb6-4333-a140-5935cdbed714. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.network.neutron [req-1b718a65-777f-4980-91a9-232875ab220b req-9c98d7f8-848a-43c7-a57c-069862320a8d service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updating instance_info_cache with network_info: [{"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1b718a65-777f-4980-91a9-232875ab220b req-9c98d7f8-848a-43c7-a57c-069862320a8d service nova] Releasing lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e.part /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e.converted" returned: 0 in 0.664s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e.converted --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e.converted --force-share --output=json" returned: 0 in 0.161s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "22a8ff649151c19c1cd129ff081975377d81863e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.402s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "22a8ff649151c19c1cd129ff081975377d81863e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "22a8ff649151c19c1cd129ff081975377d81863e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e,backing_fmt=raw /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.rescue {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e,backing_fmt=raw /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.rescue" returned: 0 in 0.056s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "22a8ff649151c19c1cd129ff081975377d81863e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'migration_context' on Instance uuid 4f686b79-b22d-4453-ae35-7a1133d7aa86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Start _get_guest_xml network_info=[{"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "vif_mac": "fa:16:3e:63:a1:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd05b7cf3-dd7f-409e-93ac-7ab208aa5d7e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd568764d-5fb0-40c8-8520-0057d0bb050a', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmqZWKIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '4f686b79-b22d-4453-ae35-7a1133d7aa86', 'attached_at': '', 'detached_at': '', 'volume_id': '96ff20c5-6dd6-430e-9a18-81c906547b37', 'serial': '96ff20c5-6dd6-430e-9a18-81c906547b37'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'resources' on Instance uuid 4f686b79-b22d-4453-ae35-7a1133d7aa86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f686b79-b22d-4453-ae35-7a1133d7aa86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:46 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:46 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f686b79-b22d-4453-ae35-7a1133d7aa86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmqZWKIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:05:46 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:05:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:05:46 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:05:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:05:46 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5da3d6-a17d-4a25-8d6d-825cccab1259]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zmqZWKIH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 24 15:05:46 user nova-compute[70645]: node.name = iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37
Jul 24 15:05:46 user nova-compute[70645]: node.tpgt = -1
Jul 24 15:05:46 user nova-compute[70645]: node.startup = automatic
Jul 24 15:05:46 user nova-compute[70645]: node.leading_login = No
Jul 24 15:05:46 user nova-compute[70645]: iface.iscsi_ifacename = default
Jul 24 15:05:46 user nova-compute[70645]: iface.net_ifacename = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.ipaddress = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.prefix_len = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.hwaddress = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.transport_name = tcp
Jul 24 15:05:46 user nova-compute[70645]: iface.initiatorname = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.state = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.vlan_id = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.vlan_priority = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.vlan_state = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.iface_num = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.mtu = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.port = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.bootproto = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.subnet_mask = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.gateway = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.dhcp_alt_client_id_state = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.dhcp_alt_client_id = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.dhcp_dns = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.dhcp_learn_iqn = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.dhcp_req_vendor_id_state = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.dhcp_vendor_id_state = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.dhcp_vendor_id = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.dhcp_slp_da = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.fragmentation = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.gratuitous_arp = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.incoming_forwarding = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.tos_state = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.tos = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.ttl = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.delayed_ack = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.tcp_nagle = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.tcp_wsf_state = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.tcp_wsf = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.tcp_timer_scale = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.tcp_timestamp = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.redirect = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.def_task_mgmt_timeout = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.header_digest = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.data_digest = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.immediate_data = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.initial_r2t = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.data_seq_inorder = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.data_pdu_inorder = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.erl = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.max_receive_data_len = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.first_burst_len = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.max_outstanding_r2t = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.max_burst_len = 0
Jul 24 15:05:46 user nova-compute[70645]: iface.chap_auth = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.bidi_chap = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.strict_login_compliance = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.discovery_auth = <empty>
Jul 24 15:05:46 user nova-compute[70645]: iface.discovery_logout = <empty>
Jul 24 15:05:46 user nova-compute[70645]: node.discovery_address = <empty>
Jul 24 15:05:46 user nova-compute[70645]: node.discovery_port = 0
Jul 24 15:05:46 user nova-compute[70645]: node.discovery_type = static
Jul 24 15:05:46 user nova-compute[70645]: node.session.initial_cmdsn = 0
Jul 24 15:05:46 user nova-compute[70645]: node.session.initial_login_retry_max = 8
Jul 24 15:05:46 user nova-compute[70645]: node.session.xmit_thread_priority = -20
Jul 24 15:05:46 user nova-compute[70645]: node.session.cmds_max = 128
Jul 24 15:05:46 user nova-compute[70645]: node.session.queue_depth = 32
Jul 24 15:05:46 user nova-compute[70645]: node.session.nr_sessions = 1
Jul 24 15:05:46 user nova-compute[70645]: node.session.auth.authmethod = CHAP
Jul 24 15:05:46 user nova-compute[70645]: node.session.auth.username = zmqZWKIH
Jul 24 15:05:46 user nova-compute[70645]: node.session.auth.password = ***
Jul 24 15:05:46 user nova-compute[70645]: node.session.auth.username_in = <empty>
Jul 24 15:05:46 user nova-compute[70645]: node.session.auth.password_in = <empty>
Jul 24 15:05:46 user nova-compute[70645]: node.session.auth.chap_algs = MD5
Jul 24 15:05:46 user nova-compute[70645]: node.session.timeo.replacement_timeout = 120
Jul 24 15:05:46 user nova-compute[70645]: node.session.err_timeo.abort_timeout = 15
Jul 24 15:05:46 user nova-compute[70645]: node.session.err_timeo.lu_reset_timeout = 30
Jul 24 15:05:46 user nova-compute[70645]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 24 15:05:46 user nova-compute[70645]: node.session.err_timeo.host_reset_timeout = 60
Jul 24 15:05:46 user nova-compute[70645]: node.session.iscsi.FastAbort = Yes
Jul 24 15:05:46 user nova-compute[70645]: node.session.iscsi.InitialR2T = No
Jul 24 15:05:46 user nova-compute[70645]: node.session.iscsi.ImmediateData = Yes
Jul 24 15:05:46 user nova-compute[70645]: node.session.iscsi.FirstBurstLength = 262144
Jul 24 15:05:46 user nova-compute[70645]: node.session.iscsi.MaxBurstLength = 16776192
Jul 24 15:05:46 user nova-compute[70645]: node.session.iscsi.DefaultTime2Retain = 0
Jul 24 15:05:46 user nova-compute[70645]: node.session.iscsi.DefaultTime2Wait = 2
Jul 24 15:05:46 user nova-compute[70645]: node.session.iscsi.MaxConnections = 1
Jul 24 15:05:46 user nova-compute[70645]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 24 15:05:46 user nova-compute[70645]: node.session.iscsi.ERL = 0
Jul 24 15:05:46 user nova-compute[70645]: node.session.scan = manual
Jul 24 15:05:46 user nova-compute[70645]: node.session.reopen_max = 0
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].address = 172.16.0.220
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].port = 3260
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].startup = manual
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].tcp.window_size = 524288
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].tcp.type_of_service = 0
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].timeo.logout_timeout = 15
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].timeo.login_timeout = 15
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].timeo.auth_timeout = 45
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].timeo.noop_out_interval = 5
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].timeo.noop_out_timeout = 5
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].iscsi.HeaderDigest = None
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].iscsi.DataDigest = None
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].iscsi.IFMarker = No
Jul 24 15:05:46 user nova-compute[70645]: node.conn[0].iscsi.OFMarker = No
Jul 24 15:05:46 user nova-compute[70645]: # END RECORD
Jul 24 15:05:46 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af5b1fb-fdbb-4b2e-a22c-12dad3f6be3f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd39aef-0838-4fa8-ac41-a3b8fe45f516]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmqZWKIH {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmqZWKIH" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d4b68a-1574-4141-9eb4-151be87d1ab4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmqZWKIH'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b05bc08-efac-42c1-9b14-3c06bc1135c9]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3daedd8-7390-4d8e-b0ed-e785b5823261]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:05:47 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:05:47 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:05:47 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:05:47 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:05:47 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:05:47 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.170s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] HCTL ('35', '0', '0', 0) found on session 31 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5d2234-f3cc-47c6-b732-c28e6f67ec2c]: (4, ('0 0 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Searching for a device in session 31 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmqZWKIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.198s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] <== connect_volume: return (199ms) {'type': 'block', 'scsi_wwn': '23733623064333766', 'path': '/dev/sdd'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733623064333766', 'path': '/dev/sdd'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1406665233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1406665233',id=27,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-ttaam4dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:04:11Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=4f686b79-b22d-4453-ae35-7a1133d7aa86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "vif_mac": "fa:16:3e:63:a1:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "vif_mac": "fa:16:3e:63:a1:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:a1:8d,bridge_name='br-int',has_traffic_filtering=True,id=fb210eeb-c5aa-4c30-988b-772930ecc039,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb210eeb-c5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG nova.objects.instance [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f686b79-b22d-4453-ae35-7a1133d7aa86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:05:47 user nova-compute[70645]:   <uuid>4f686b79-b22d-4453-ae35-7a1133d7aa86</uuid>
Jul 24 15:05:47 user nova-compute[70645]:   <name>instance-0000001b</name>
Jul 24 15:05:47 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:05:47 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:05:47 user nova-compute[70645]:   <metadata>
Jul 24 15:05:47 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:05:47 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:05:47 user nova-compute[70645]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1406665233</nova:name>
Jul 24 15:05:47 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:05:46</nova:creationTime>
Jul 24 15:05:47 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:05:47 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:05:47 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:05:47 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:05:47 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:05:47 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:05:47 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:05:47 user nova-compute[70645]:       <nova:owner>
Jul 24 15:05:47 user nova-compute[70645]:         <nova:user uuid="192b7bd8dd234dceadc22ba7bb092344">tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member</nova:user>
Jul 24 15:05:47 user nova-compute[70645]:         <nova:project uuid="bab8baa391424072ba5bcea7f54f0242">tempest-ServerBootFromVolumeStableRescueTest-1550895590</nova:project>
Jul 24 15:05:47 user nova-compute[70645]:       </nova:owner>
Jul 24 15:05:47 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:05:47 user nova-compute[70645]:       <nova:ports>
Jul 24 15:05:47 user nova-compute[70645]:         <nova:port uuid="fb210eeb-c5aa-4c30-988b-772930ecc039">
Jul 24 15:05:47 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 15:05:47 user nova-compute[70645]:         </nova:port>
Jul 24 15:05:47 user nova-compute[70645]:       </nova:ports>
Jul 24 15:05:47 user nova-compute[70645]:     </nova:instance>
Jul 24 15:05:47 user nova-compute[70645]:   </metadata>
Jul 24 15:05:47 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:05:47 user nova-compute[70645]:     <system>
Jul 24 15:05:47 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:05:47 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:05:47 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:05:47 user nova-compute[70645]:       <entry name="serial">4f686b79-b22d-4453-ae35-7a1133d7aa86</entry>
Jul 24 15:05:47 user nova-compute[70645]:       <entry name="uuid">4f686b79-b22d-4453-ae35-7a1133d7aa86</entry>
Jul 24 15:05:47 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:05:47 user nova-compute[70645]:     </system>
Jul 24 15:05:47 user nova-compute[70645]:   </sysinfo>
Jul 24 15:05:47 user nova-compute[70645]:   <os>
Jul 24 15:05:47 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:05:47 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:05:47 user nova-compute[70645]:   </os>
Jul 24 15:05:47 user nova-compute[70645]:   <features>
Jul 24 15:05:47 user nova-compute[70645]:     <acpi/>
Jul 24 15:05:47 user nova-compute[70645]:     <apic/>
Jul 24 15:05:47 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:05:47 user nova-compute[70645]:   </features>
Jul 24 15:05:47 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:05:47 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:05:47 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:05:47 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:05:47 user nova-compute[70645]:   </clock>
Jul 24 15:05:47 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:05:47 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:05:47 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:05:47 user nova-compute[70645]:   </cpu>
Jul 24 15:05:47 user nova-compute[70645]:   <devices>
Jul 24 15:05:47 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:05:47 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:05:47 user nova-compute[70645]:       <source dev="/dev/sdd"/>
Jul 24 15:05:47 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:05:47 user nova-compute[70645]:       <serial>96ff20c5-6dd6-430e-9a18-81c906547b37</serial>
Jul 24 15:05:47 user nova-compute[70645]:     </disk>
Jul 24 15:05:47 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:05:47 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:05:47 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.rescue"/>
Jul 24 15:05:47 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 15:05:47 user nova-compute[70645]:       <boot order="1"/>
Jul 24 15:05:47 user nova-compute[70645]:     </disk>
Jul 24 15:05:47 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:05:47 user nova-compute[70645]:       <mac address="fa:16:3e:63:a1:8d"/>
Jul 24 15:05:47 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:05:47 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:05:47 user nova-compute[70645]:       <target dev="tapfb210eeb-c5"/>
Jul 24 15:05:47 user nova-compute[70645]:     </interface>
Jul 24 15:05:47 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:05:47 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/console.log" append="off"/>
Jul 24 15:05:47 user nova-compute[70645]:     </serial>
Jul 24 15:05:47 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:05:47 user nova-compute[70645]:     <video>
Jul 24 15:05:47 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:05:47 user nova-compute[70645]:     </video>
Jul 24 15:05:47 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:05:47 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:05:47 user nova-compute[70645]:     </rng>
Jul 24 15:05:47 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:05:47 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:05:47 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:05:47 user nova-compute[70645]:     </memballoon>
Jul 24 15:05:47 user nova-compute[70645]:   </devices>
Jul 24 15:05:47 user nova-compute[70645]: </domain>
Jul 24 15:05:47 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:05:47 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Instance destroyed successfully.
Jul 24 15:05:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] No VIF found with MAC fa:16:3e:63:a1:8d, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-2a2badaa-979b-451a-84ee-643e262d60a7 req-523655e0-0c78-4344-98a1-18245e1c2d7b service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2a2badaa-979b-451a-84ee-643e262d60a7 req-523655e0-0c78-4344-98a1-18245e1c2d7b service nova] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2a2badaa-979b-451a-84ee-643e262d60a7 req-523655e0-0c78-4344-98a1-18245e1c2d7b service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2a2badaa-979b-451a-84ee-643e262d60a7 req-523655e0-0c78-4344-98a1-18245e1c2d7b service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-2a2badaa-979b-451a-84ee-643e262d60a7 req-523655e0-0c78-4344-98a1-18245e1c2d7b service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] No waiting events found dispatching network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:47 user nova-compute[70645]: WARNING nova.compute.manager [req-2a2badaa-979b-451a-84ee-643e262d60a7 req-523655e0-0c78-4344-98a1-18245e1c2d7b service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received unexpected event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 for instance with vm_state building and task_state spawning.
Jul 24 15:05:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-3d4fa2d9-6ba1-4ebb-9a20-4cae9605840b req-29759d05-f769-4c88-8246-cd1df6586d58 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3d4fa2d9-6ba1-4ebb-9a20-4cae9605840b req-29759d05-f769-4c88-8246-cd1df6586d58 service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3d4fa2d9-6ba1-4ebb-9a20-4cae9605840b req-29759d05-f769-4c88-8246-cd1df6586d58 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3d4fa2d9-6ba1-4ebb-9a20-4cae9605840b req-29759d05-f769-4c88-8246-cd1df6586d58 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-3d4fa2d9-6ba1-4ebb-9a20-4cae9605840b req-29759d05-f769-4c88-8246-cd1df6586d58 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:49 user nova-compute[70645]: WARNING nova.compute.manager [req-3d4fa2d9-6ba1-4ebb-9a20-4cae9605840b req-29759d05-f769-4c88-8246-cd1df6586d58 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received unexpected event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with vm_state active and task_state rescuing.
Jul 24 15:05:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-32d6ad16-982c-44d1-8258-de0b116e95c2 req-bab1332c-5d84-457b-a7d9-26e9f86c9117 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-32d6ad16-982c-44d1-8258-de0b116e95c2 req-bab1332c-5d84-457b-a7d9-26e9f86c9117 service nova] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-32d6ad16-982c-44d1-8258-de0b116e95c2 req-bab1332c-5d84-457b-a7d9-26e9f86c9117 service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-32d6ad16-982c-44d1-8258-de0b116e95c2 req-bab1332c-5d84-457b-a7d9-26e9f86c9117 service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-32d6ad16-982c-44d1-8258-de0b116e95c2 req-bab1332c-5d84-457b-a7d9-26e9f86c9117 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] No waiting events found dispatching network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:49 user nova-compute[70645]: WARNING nova.compute.manager [req-32d6ad16-982c-44d1-8258-de0b116e95c2 req-bab1332c-5d84-457b-a7d9-26e9f86c9117 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received unexpected event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 for instance with vm_state building and task_state spawning.
Jul 24 15:05:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211151.1856332, 50dc20e7-65ef-4743-8707-9ef7da98f947 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:51 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] VM Resumed (Lifecycle Event)
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:05:51 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Instance spawned successfully.
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:05:51 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211151.187446, 50dc20e7-65ef-4743-8707-9ef7da98f947 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:51 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] VM Started (Lifecycle Event)
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:05:51 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:05:51 user nova-compute[70645]: INFO nova.compute.manager [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Took 9.55 seconds to spawn the instance on the hypervisor.
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:51 user nova-compute[70645]: INFO nova.compute.manager [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Took 10.74 seconds to build instance.
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-49a999ca-350b-40d9-8ab9-0f5ef7cccb67 req-8fbc7f88-86a0-40da-ae0f-a601d6a8ccfd service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-49a999ca-350b-40d9-8ab9-0f5ef7cccb67 req-8fbc7f88-86a0-40da-ae0f-a601d6a8ccfd service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-49a999ca-350b-40d9-8ab9-0f5ef7cccb67 req-8fbc7f88-86a0-40da-ae0f-a601d6a8ccfd service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-49a999ca-350b-40d9-8ab9-0f5ef7cccb67 req-8fbc7f88-86a0-40da-ae0f-a601d6a8ccfd service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-49a999ca-350b-40d9-8ab9-0f5ef7cccb67 req-8fbc7f88-86a0-40da-ae0f-a601d6a8ccfd service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:05:51 user nova-compute[70645]: WARNING nova.compute.manager [req-49a999ca-350b-40d9-8ab9-0f5ef7cccb67 req-8fbc7f88-86a0-40da-ae0f-a601d6a8ccfd service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received unexpected event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with vm_state active and task_state rescuing.
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNTMvPLk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:05:51 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:05:51 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:05:51 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9b7f878-ea23-4be1-8b59-efc9c6843794 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.882s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c55073-e697-4cd0-969f-7b72ea06b48f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:05:51 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[308d2b8a-bdab-43f8-ae12-bae933e5475f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4] added
Jul 24 15:05:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53cf159-f945-47e7-b5d7-9be353032bca]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fbf46a-7545-4a26-81b4-00da3d2bcb37]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UNTMvPLk {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UNTMvPLk" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b7ebdc-7638-4e67-9e27-53a1f5f9d6d6]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UNTMvPLk'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6016db72-1c92-48ee-8fcc-c5b490bf621b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f91eb2-e926-4729-a552-9f39db3e0eb3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:05:51 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:05:51 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:05:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:05:51 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:05:51 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:05:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b495e81e-4621-4a9b-a942-4ee3f8579dd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4, portal: 172.16.0.220,3260]
Jul 24 15:05:51 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4, portal: 172.16.0.220,3260] successful.
Jul 24 15:05:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c36ce3-945d-4fe1-a99a-a6e329fe6999]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[de857dd7-ffbd-42ed-8e1b-6261f378e6af]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:05:51 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:05:51 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:05:51 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:05:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:05:51 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:05:51 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:05:51 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:05:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 4f686b79-b22d-4453-ae35-7a1133d7aa86 due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211151.7789707, 4f686b79-b22d-4453-ae35-7a1133d7aa86 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:51 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] VM Resumed (Lifecycle Event)
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-09ea9b50-6932-41d4-a401-1bdd9ce40471 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[333a7122-c778-4f7e-adec-a17935da70a6]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:05:51 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211151.780139, 4f686b79-b22d-4453-ae35-7a1133d7aa86 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:05:51 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] VM Started (Lifecycle Event)
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:05:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:05:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:52 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:05:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNTMvPLk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:05:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:05:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23666343237653031', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:05:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666343237653031', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:05:52 user nova-compute[70645]: DEBUG nova.objects.instance [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lazy-loading 'flavor' on Instance uuid 8ad33774-2d1b-480d-871d-f422c941c806 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:05:52 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:05:52 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:05:52 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:05:52 user nova-compute[70645]:   <serial>087aa622-8e57-46e5-bd74-fae2d812a9c4</serial>
Jul 24 15:05:52 user nova-compute[70645]: </disk>
Jul 24 15:05:52 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:05:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:05:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:05:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] No VIF found with MAC fa:16:3e:e3:de:db, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:05:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21648d5e-54eb-40b7-8021-b1b20fd58d88 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.560s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lazy-loading 'flavor' on Instance uuid 8ad33774-2d1b-480d-871d-f422c941c806 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:05:59 user nova-compute[70645]: INFO nova.compute.manager [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Attaching volume 24a5aad2-97b9-4494-9fdd-21af70acff69 to /dev/vdc
Jul 24 15:05:59 user nova-compute[70645]: DEBUG os_brick.utils [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[51475fcf-0c7e-47f7-a973-db9587f4411a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fad314-2ff1-447a-90ed-39e9b02dac0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a8d400-84d3-42c7-b22a-5d6e1ebb3010]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d73a265-61b5-457a-af1d-3418ad4c8172]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:05:59 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:05:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8926100-b92d-4454-8ba6-5465341c45b4]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG os_brick.utils [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:05:59 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Updating existing volume attachment record: 7c3d1318-41be-4ecf-91aa-2d41998615af {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:06:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquired lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'info_cache' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWlUXFOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:06:08 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:06:08 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:06:08 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc82049f-08d1-4101-885d-2cb3188abf11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:06:08 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcabd0e-6e65-476d-aa5e-d156f2df6094]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69] added
Jul 24 15:06:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbefbd1-11bf-4421-86e0-4fffcf54feb0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a90904-8f40-4862-85e5-0fa3dd8faa77]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aWlUXFOM {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aWlUXFOM" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d613f2-f29f-4856-bbda-3c967322b373]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aWlUXFOM'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d12746-881e-417d-99fc-dc7b1192f66e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3665fc22-a14d-4c82-b1f8-da9d9b5a6e3d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:06:08 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:06:08 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:06:08 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:06:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:06:08 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:06:08 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:06:08 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:06:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:06:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Updating instance_info_cache with network_info: [{"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Releasing lock "refresh_cache-734abf9a-96dd-40b4-9b68-2d42fa079216" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:06:09 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance destroyed successfully.
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'resources' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1841824952',display_name='tempest-AttachVolumeTestJSON-server-1841824952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1841824952',id=22,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMLbkQBMsR4a+hDUBr6a7aRbORe6/on6xHkq0RJlZIGJHHSRDeijoBX284tbAvvwuA6Lxntt8t7PR2NgacxtAM+JNC3dlGGca1WYyP9ZD/+aBRiNcvf5TmXBq0Tu+cQQw==',key_name='tempest-keypair-548846795',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-x9wujour',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=734abf9a-96dd-40b4-9b68-2d42fa079216,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_vif [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b0b4c4-26cd-4760-9f13-2ce983c5d055]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69, portal: 172.16.0.220,3260]
Jul 24 15:06:09 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69, portal: 172.16.0.220,3260] successful.
Jul 24 15:06:09 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap634fb15f-19, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:06:09 user nova-compute[70645]: INFO os_vif [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19')
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Start _get_guest_xml network_info=[{"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'numa_topology' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b09be8-fd83-4473-a89d-08f75eb4221a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:09 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:06:09 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'vcpu_model' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ff97c7-6580-4f03-8069-150de421b7c1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:06:09 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:06:09 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:06:09 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:06:09 user nova-compute[70645]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 (non-flash)
Jul 24 15:06:09 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:06:09 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:06:09 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:06:09 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:06:09 user nova-compute[70645]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 (non-flash)
Jul 24 15:06:09 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1841824952',display_name='tempest-AttachVolumeTestJSON-server-1841824952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1841824952',id=22,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMLbkQBMsR4a+hDUBr6a7aRbORe6/on6xHkq0RJlZIGJHHSRDeijoBX284tbAvvwuA6Lxntt8t7PR2NgacxtAM+JNC3dlGGca1WYyP9ZD/+aBRiNcvf5TmXBq0Tu+cQQw==',key_name='tempest-keypair-548846795',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-x9wujour',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=734abf9a-96dd-40b4-9b68-2d42fa079216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'pci_devices' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb726f6-40bd-4ffd-bc3b-342023f7084a]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWlUXFOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:06:09 user nova-compute[70645]:   <uuid>734abf9a-96dd-40b4-9b68-2d42fa079216</uuid>
Jul 24 15:06:09 user nova-compute[70645]:   <name>instance-00000016</name>
Jul 24 15:06:09 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:06:09 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:06:09 user nova-compute[70645]:   <metadata>
Jul 24 15:06:09 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:06:09 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:06:09 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeTestJSON-server-1841824952</nova:name>
Jul 24 15:06:09 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:06:09</nova:creationTime>
Jul 24 15:06:09 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:06:09 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:06:09 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:06:09 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:06:09 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:06:09 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:06:09 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:06:09 user nova-compute[70645]:       <nova:owner>
Jul 24 15:06:09 user nova-compute[70645]:         <nova:user uuid="fa4b836a11a044a583cb21072f0e4922">tempest-AttachVolumeTestJSON-1397935195-project-member</nova:user>
Jul 24 15:06:09 user nova-compute[70645]:         <nova:project uuid="2dacb396f6be4936ac1c4d115bf98d6a">tempest-AttachVolumeTestJSON-1397935195</nova:project>
Jul 24 15:06:09 user nova-compute[70645]:       </nova:owner>
Jul 24 15:06:09 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:06:09 user nova-compute[70645]:       <nova:ports>
Jul 24 15:06:09 user nova-compute[70645]:         <nova:port uuid="634fb15f-19aa-462c-931b-dd76f2ce93b0">
Jul 24 15:06:09 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 15:06:09 user nova-compute[70645]:         </nova:port>
Jul 24 15:06:09 user nova-compute[70645]:       </nova:ports>
Jul 24 15:06:09 user nova-compute[70645]:     </nova:instance>
Jul 24 15:06:09 user nova-compute[70645]:   </metadata>
Jul 24 15:06:09 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:06:09 user nova-compute[70645]:     <system>
Jul 24 15:06:09 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:06:09 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:06:09 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:06:09 user nova-compute[70645]:       <entry name="serial">734abf9a-96dd-40b4-9b68-2d42fa079216</entry>
Jul 24 15:06:09 user nova-compute[70645]:       <entry name="uuid">734abf9a-96dd-40b4-9b68-2d42fa079216</entry>
Jul 24 15:06:09 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:06:09 user nova-compute[70645]:     </system>
Jul 24 15:06:09 user nova-compute[70645]:   </sysinfo>
Jul 24 15:06:09 user nova-compute[70645]:   <os>
Jul 24 15:06:09 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:06:09 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:06:09 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:06:09 user nova-compute[70645]:   </os>
Jul 24 15:06:09 user nova-compute[70645]:   <features>
Jul 24 15:06:09 user nova-compute[70645]:     <acpi/>
Jul 24 15:06:09 user nova-compute[70645]:     <apic/>
Jul 24 15:06:09 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:06:09 user nova-compute[70645]:   </features>
Jul 24 15:06:09 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:06:09 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:06:09 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:06:09 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:06:09 user nova-compute[70645]:   </clock>
Jul 24 15:06:09 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:06:09 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:06:09 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:06:09 user nova-compute[70645]:   </cpu>
Jul 24 15:06:09 user nova-compute[70645]:   <devices>
Jul 24 15:06:09 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:06:09 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:06:09 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk"/>
Jul 24 15:06:09 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:06:09 user nova-compute[70645]:     </disk>
Jul 24 15:06:09 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:06:09 user nova-compute[70645]:       <mac address="fa:16:3e:c7:b9:c5"/>
Jul 24 15:06:09 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:06:09 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:06:09 user nova-compute[70645]:       <target dev="tap634fb15f-19"/>
Jul 24 15:06:09 user nova-compute[70645]:     </interface>
Jul 24 15:06:09 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:06:09 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/console.log" append="off"/>
Jul 24 15:06:09 user nova-compute[70645]:     </serial>
Jul 24 15:06:09 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:06:09 user nova-compute[70645]:     <video>
Jul 24 15:06:09 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:06:09 user nova-compute[70645]:     </video>
Jul 24 15:06:09 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:06:09 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:06:09 user nova-compute[70645]:     </rng>
Jul 24 15:06:09 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:06:09 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:06:09 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:06:09 user nova-compute[70645]:     </memballoon>
Jul 24 15:06:09 user nova-compute[70645]:   </devices>
Jul 24 15:06:09 user nova-compute[70645]: </domain>
Jul 24 15:06:09 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'trusted_certs' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Cannot resize image /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'migration_context' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1841824952',display_name='tempest-AttachVolumeTestJSON-server-1841824952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1841824952',id=22,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMLbkQBMsR4a+hDUBr6a7aRbORe6/on6xHkq0RJlZIGJHHSRDeijoBX284tbAvvwuA6Lxntt8t7PR2NgacxtAM+JNC3dlGGca1WYyP9ZD/+aBRiNcvf5TmXBq0Tu+cQQw==',key_name='tempest-keypair-548846795',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-x9wujour',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=734abf9a-96dd-40b4-9b68-2d42fa079216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG os_vif [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap634fb15f-19, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap634fb15f-19, col_values=(('external_ids', {'iface-id': '634fb15f-19aa-462c-931b-dd76f2ce93b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:b9:c5', 'vm-uuid': '734abf9a-96dd-40b4-9b68-2d42fa079216'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:06:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:09 user nova-compute[70645]: INFO os_vif [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19')
Jul 24 15:06:10 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:06:10 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26164363438656430', 'path': '/dev/sde'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:06:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164363438656430', 'path': '/dev/sde'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:06:10 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lazy-loading 'flavor' on Instance uuid 8ad33774-2d1b-480d-871d-f422c941c806 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:06:10 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:06:10 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:06:10 user nova-compute[70645]:   <target dev="vdc" bus="virtio"/>
Jul 24 15:06:10 user nova-compute[70645]:   <serial>24a5aad2-97b9-4494-9fdd-21af70acff69</serial>
Jul 24 15:06:10 user nova-compute[70645]: </disk>
Jul 24 15:06:10 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:06:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:06:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:06:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:06:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] No VIF found with MAC fa:16:3e:e3:de:db, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:06:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2480e733-a1c1-4050-869d-a54b2df45c77 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.640s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:11 user nova-compute[70645]: INFO nova.compute.manager [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Detaching volume 24a5aad2-97b9-4494-9fdd-21af70acff69
Jul 24 15:06:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:11 user nova-compute[70645]: INFO nova.virt.block_device [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Attempting to driver detach volume 24a5aad2-97b9-4494-9fdd-21af70acff69 from mountpoint /dev/vdc
Jul 24 15:06:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Attempting to detach device vdc from instance 8ad33774-2d1b-480d-871d-f422c941c806 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:06:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:06:11 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:06:11 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:06:11 user nova-compute[70645]:   <target dev="vdc" bus="virtio"/>
Jul 24 15:06:11 user nova-compute[70645]:   <serial>24a5aad2-97b9-4494-9fdd-21af70acff69</serial>
Jul 24 15:06:11 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 15:06:11 user nova-compute[70645]: </disk>
Jul 24 15:06:11 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:06:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Successfully detached device vdc from instance 8ad33774-2d1b-480d-871d-f422c941c806 from the persistent domain config.
Jul 24 15:06:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8ad33774-2d1b-480d-871d-f422c941c806 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:06:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:06:11 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:06:11 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:06:11 user nova-compute[70645]:   <target dev="vdc" bus="virtio"/>
Jul 24 15:06:11 user nova-compute[70645]:   <serial>24a5aad2-97b9-4494-9fdd-21af70acff69</serial>
Jul 24 15:06:11 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 15:06:11 user nova-compute[70645]: </disk>
Jul 24 15:06:11 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-0319a8f6-e3a4-4755-8b0c-2d6c913eb228 req-8a1b9eea-454e-4245-a0c7-5afaf03536d7 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0319a8f6-e3a4-4755-8b0c-2d6c913eb228 req-8a1b9eea-454e-4245-a0c7-5afaf03536d7 service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0319a8f6-e3a4-4755-8b0c-2d6c913eb228 req-8a1b9eea-454e-4245-a0c7-5afaf03536d7 service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0319a8f6-e3a4-4755-8b0c-2d6c913eb228 req-8a1b9eea-454e-4245-a0c7-5afaf03536d7 service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-0319a8f6-e3a4-4755-8b0c-2d6c913eb228 req-8a1b9eea-454e-4245-a0c7-5afaf03536d7 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:06:12 user nova-compute[70645]: WARNING nova.compute.manager [req-0319a8f6-e3a4-4755-8b0c-2d6c913eb228 req-8a1b9eea-454e-4245-a0c7-5afaf03536d7 service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state stopped and task_state powering-on.
Jul 24 15:06:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211172.2275324, 8ad33774-2d1b-480d-871d-f422c941c806 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8ad33774-2d1b-480d-871d-f422c941c806 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:06:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Successfully detached device vdc from instance 8ad33774-2d1b-480d-871d-f422c941c806 from the live domain config.
Jul 24 15:06:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWlUXFOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:06:12 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e544254-c59a-47ce-ae91-bb6f1abf0738]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b7152e-995a-4470-b221-34cfd8f7280f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:06:12 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:06:12 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:06:12 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:06:12 user nova-compute[70645]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 (non-flash)
Jul 24 15:06:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:06:12 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:06:12 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:06:12 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:06:12 user nova-compute[70645]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 (non-flash)
Jul 24 15:06:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba8467a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69'): ({'sde'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Removing single pathed devices sde {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd35bbb1-40cd-47a1-86b5-b716d53cb6bf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfb0e8e-27f5-43ed-98e5-36325efb41e4]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Flushing IO for device /dev/sde {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda22c01-a55c-4916-8f18-dcbc8b730b81]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.079s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f45180-4c9f-4c38-803f-243353fb1377]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] SCSI volumes sde have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfeb55f-1e5d-4f4f-a01d-6b751bbe19bb]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e181f4-c1f3-4ea2-9d8d-f10312210e9c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69, portal: 172.16.0.220,3260]
Jul 24 15:06:12 user nova-compute[70645]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69, portal: 172.16.0.220,3260] successful.
Jul 24 15:06:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a5aad2-97b9-4494-9fdd-21af70acff69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[24344a6e-2c1c-4d67-88bf-798c3b58fe06]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] <== disconnect_volume: return (395ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:06:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:06:13 user nova-compute[70645]: DEBUG nova.objects.instance [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lazy-loading 'flavor' on Instance uuid 8ad33774-2d1b-480d-871d-f422c941c806 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a67cf784-1e8a-4d64-aa60-07d900ff987f tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.941s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-0d9db803-6f18-4f08-8e75-4f5bc08f2221 req-c89ae488-a303-4f59-b162-7c8c2f95d49f service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:06:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0d9db803-6f18-4f08-8e75-4f5bc08f2221 req-c89ae488-a303-4f59-b162-7c8c2f95d49f service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0d9db803-6f18-4f08-8e75-4f5bc08f2221 req-c89ae488-a303-4f59-b162-7c8c2f95d49f service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0d9db803-6f18-4f08-8e75-4f5bc08f2221 req-c89ae488-a303-4f59-b162-7c8c2f95d49f service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-0d9db803-6f18-4f08-8e75-4f5bc08f2221 req-c89ae488-a303-4f59-b162-7c8c2f95d49f service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:06:14 user nova-compute[70645]: WARNING nova.compute.manager [req-0d9db803-6f18-4f08-8e75-4f5bc08f2221 req-c89ae488-a303-4f59-b162-7c8c2f95d49f service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state stopped and task_state powering-on.
Jul 24 15:06:14 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211174.2791996, 734abf9a-96dd-40b4-9b68-2d42fa079216 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:06:14 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] VM Resumed (Lifecycle Event)
Jul 24 15:06:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:06:14 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance rebooted successfully.
Jul 24 15:06:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9f3944d4-5f4b-40ac-afc1-eae4009e10a6 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:06:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:06:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:06:14 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 24 15:06:14 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211174.2795684, 734abf9a-96dd-40b4-9b68-2d42fa079216 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:06:14 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] VM Started (Lifecycle Event)
Jul 24 15:06:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:06:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:06:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:21 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:06:21 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:06:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:22 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:06:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:06:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:06:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:27 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:06:27 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=6978MB free_disk=25.210132598876953GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.manager [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 734abf9a-96dd-40b4-9b68-2d42fa079216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 07adce07-b416-44fb-b548-17b8cd0d8168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 8ad33774-2d1b-480d-871d-f422c941c806 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 4f686b79-b22d-4453-ae35-7a1133d7aa86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 82005166-20b9-4dce-b0fe-812766f1670d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 50dc20e7-65ef-4743-8707-9ef7da98f947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1724}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:06:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.428s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:06:28 user nova-compute[70645]: INFO nova.compute.claims [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Claim successful on node user
Jul 24 15:06:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.network.neutron [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:06:28 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.policy [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74440f1d0cf141fdb6b40b0d1e3a5d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f8500e5a144902be74f12f3caf8ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:06:28 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Creating image(s)
Jul 24 15:06:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "/opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk 1073741824" returned: 0 in 0.055s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Skipping network cache update for instance because it is Building. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid b13c0261-b25c-48ce-9245-fa43dadc1829 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG nova.network.neutron [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Successfully created port: e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Cannot resize image /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG nova.objects.instance [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'migration_context' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Ensure instance console log exists: /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Updating instance_info_cache with network_info: [{"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-b13c0261-b25c-48ce-9245-fa43dadc1829" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Successfully updated port: e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquired lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-98f42052-4462-4bbe-a59b-8295d58ef9c4 req-7d745812-3ef0-467c-b4ac-23b5f7334764 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-changed-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-98f42052-4462-4bbe-a59b-8295d58ef9c4 req-7d745812-3ef0-467c-b4ac-23b5f7334764 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Refreshing instance network info cache due to event network-changed-e5c114ae-433c-4886-8a50-0c01256585af. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-98f42052-4462-4bbe-a59b-8295d58ef9c4 req-7d745812-3ef0-467c-b4ac-23b5f7334764 service nova] Acquiring lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updating instance_info_cache with network_info: [{"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Releasing lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Instance network_info: |[{"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-98f42052-4462-4bbe-a59b-8295d58ef9c4 req-7d745812-3ef0-467c-b4ac-23b5f7334764 service nova] Acquired lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.network.neutron [req-98f42052-4462-4bbe-a59b-8295d58ef9c4 req-7d745812-3ef0-467c-b4ac-23b5f7334764 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Refreshing network info cache for port e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Start _get_guest_xml network_info=[{"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:06:30 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:06:30 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-682817805',display_name='tempest-ServerRescueNegativeTestJSON-server-682817805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-682817805',id=32,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONsBzgzH8OSaVH0EufkBS4/tqJwCDScyZHEPq7KVN2duIQjhyV4RSbbUo7s/YWEOXmmyUj4zOGsIkLga0IXalBEY4yu30RqKaDrugQXXQjX8kKFWpucjI6SQ0mE6fffJQ==',key_name='tempest-keypair-1103917478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-pvr9zonq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1d:1a,bridge_name='br-int',has_traffic_filtering=True,id=e5c114ae-433c-4886-8a50-0c01256585af,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c114ae-43') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.objects.instance [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'pci_devices' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:06:30 user nova-compute[70645]:   <uuid>271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3</uuid>
Jul 24 15:06:30 user nova-compute[70645]:   <name>instance-00000020</name>
Jul 24 15:06:30 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:06:30 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:06:30 user nova-compute[70645]:   <metadata>
Jul 24 15:06:30 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:06:30 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:06:30 user nova-compute[70645]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-682817805</nova:name>
Jul 24 15:06:30 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:06:30</nova:creationTime>
Jul 24 15:06:30 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:06:30 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:06:30 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:06:30 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:06:30 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:06:30 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:06:30 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:06:30 user nova-compute[70645]:       <nova:owner>
Jul 24 15:06:30 user nova-compute[70645]:         <nova:user uuid="74440f1d0cf141fdb6b40b0d1e3a5d13">tempest-ServerRescueNegativeTestJSON-1652524619-project-member</nova:user>
Jul 24 15:06:30 user nova-compute[70645]:         <nova:project uuid="c3f8500e5a144902be74f12f3caf8ae2">tempest-ServerRescueNegativeTestJSON-1652524619</nova:project>
Jul 24 15:06:30 user nova-compute[70645]:       </nova:owner>
Jul 24 15:06:30 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:06:30 user nova-compute[70645]:       <nova:ports>
Jul 24 15:06:30 user nova-compute[70645]:         <nova:port uuid="e5c114ae-433c-4886-8a50-0c01256585af">
Jul 24 15:06:30 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 15:06:30 user nova-compute[70645]:         </nova:port>
Jul 24 15:06:30 user nova-compute[70645]:       </nova:ports>
Jul 24 15:06:30 user nova-compute[70645]:     </nova:instance>
Jul 24 15:06:30 user nova-compute[70645]:   </metadata>
Jul 24 15:06:30 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:06:30 user nova-compute[70645]:     <system>
Jul 24 15:06:30 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:06:30 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:06:30 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:06:30 user nova-compute[70645]:       <entry name="serial">271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3</entry>
Jul 24 15:06:30 user nova-compute[70645]:       <entry name="uuid">271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3</entry>
Jul 24 15:06:30 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:06:30 user nova-compute[70645]:     </system>
Jul 24 15:06:30 user nova-compute[70645]:   </sysinfo>
Jul 24 15:06:30 user nova-compute[70645]:   <os>
Jul 24 15:06:30 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:06:30 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:06:30 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:06:30 user nova-compute[70645]:   </os>
Jul 24 15:06:30 user nova-compute[70645]:   <features>
Jul 24 15:06:30 user nova-compute[70645]:     <acpi/>
Jul 24 15:06:30 user nova-compute[70645]:     <apic/>
Jul 24 15:06:30 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:06:30 user nova-compute[70645]:   </features>
Jul 24 15:06:30 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:06:30 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:06:30 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:06:30 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:06:30 user nova-compute[70645]:   </clock>
Jul 24 15:06:30 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:06:30 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:06:30 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:06:30 user nova-compute[70645]:   </cpu>
Jul 24 15:06:30 user nova-compute[70645]:   <devices>
Jul 24 15:06:30 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:06:30 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:06:30 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk"/>
Jul 24 15:06:30 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:06:30 user nova-compute[70645]:     </disk>
Jul 24 15:06:30 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:06:30 user nova-compute[70645]:       <mac address="fa:16:3e:d4:1d:1a"/>
Jul 24 15:06:30 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:06:30 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:06:30 user nova-compute[70645]:       <target dev="tape5c114ae-43"/>
Jul 24 15:06:30 user nova-compute[70645]:     </interface>
Jul 24 15:06:30 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:06:30 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/console.log" append="off"/>
Jul 24 15:06:30 user nova-compute[70645]:     </serial>
Jul 24 15:06:30 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:06:30 user nova-compute[70645]:     <video>
Jul 24 15:06:30 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:06:30 user nova-compute[70645]:     </video>
Jul 24 15:06:30 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:06:30 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:06:30 user nova-compute[70645]:     </rng>
Jul 24 15:06:30 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:06:30 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:06:30 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:06:30 user nova-compute[70645]:     </memballoon>
Jul 24 15:06:30 user nova-compute[70645]:   </devices>
Jul 24 15:06:30 user nova-compute[70645]: </domain>
Jul 24 15:06:30 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-682817805',display_name='tempest-ServerRescueNegativeTestJSON-server-682817805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-682817805',id=32,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONsBzgzH8OSaVH0EufkBS4/tqJwCDScyZHEPq7KVN2duIQjhyV4RSbbUo7s/YWEOXmmyUj4zOGsIkLga0IXalBEY4yu30RqKaDrugQXXQjX8kKFWpucjI6SQ0mE6fffJQ==',key_name='tempest-keypair-1103917478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-pvr9zonq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1d:1a,bridge_name='br-int',has_traffic_filtering=True,id=e5c114ae-433c-4886-8a50-0c01256585af,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c114ae-43') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG os_vif [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1d:1a,bridge_name='br-int',has_traffic_filtering=True,id=e5c114ae-433c-4886-8a50-0c01256585af,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c114ae-43') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5c114ae-43, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape5c114ae-43, col_values=(('external_ids', {'iface-id': 'e5c114ae-433c-4886-8a50-0c01256585af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:1d:1a', 'vm-uuid': '271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:30 user nova-compute[70645]: INFO os_vif [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1d:1a,bridge_name='br-int',has_traffic_filtering=True,id=e5c114ae-433c-4886-8a50-0c01256585af,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c114ae-43')
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:06:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No VIF found with MAC fa:16:3e:d4:1d:1a, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:06:31 user nova-compute[70645]: DEBUG nova.network.neutron [req-98f42052-4462-4bbe-a59b-8295d58ef9c4 req-7d745812-3ef0-467c-b4ac-23b5f7334764 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updated VIF entry in instance network info cache for port e5c114ae-433c-4886-8a50-0c01256585af. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:06:31 user nova-compute[70645]: DEBUG nova.network.neutron [req-98f42052-4462-4bbe-a59b-8295d58ef9c4 req-7d745812-3ef0-467c-b4ac-23b5f7334764 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updating instance_info_cache with network_info: [{"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:06:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-98f42052-4462-4bbe-a59b-8295d58ef9c4 req-7d745812-3ef0-467c-b4ac-23b5f7334764 service nova] Releasing lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:06:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-5961734c-b146-40b6-896b-b6187d4a63be req-3b3b6a72-e2ff-4f04-b50f-c530552954c4 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:06:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5961734c-b146-40b6-896b-b6187d4a63be req-3b3b6a72-e2ff-4f04-b50f-c530552954c4 service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5961734c-b146-40b6-896b-b6187d4a63be req-3b3b6a72-e2ff-4f04-b50f-c530552954c4 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5961734c-b146-40b6-896b-b6187d4a63be req-3b3b6a72-e2ff-4f04-b50f-c530552954c4 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-5961734c-b146-40b6-896b-b6187d4a63be req-3b3b6a72-e2ff-4f04-b50f-c530552954c4 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:06:32 user nova-compute[70645]: WARNING nova.compute.manager [req-5961734c-b146-40b6-896b-b6187d4a63be req-3b3b6a72-e2ff-4f04-b50f-c530552954c4 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received unexpected event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with vm_state building and task_state spawning.
Jul 24 15:06:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211194.2980435, 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:06:34 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] VM Resumed (Lifecycle Event)
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:06:34 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Instance spawned successfully.
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:06:34 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211194.2992132, 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:06:34 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] VM Started (Lifecycle Event)
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:06:34 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:06:34 user nova-compute[70645]: INFO nova.compute.manager [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Took 5.44 seconds to spawn the instance on the hypervisor.
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:06:34 user nova-compute[70645]: INFO nova.compute.manager [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Took 6.67 seconds to build instance.
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-b5f54c53-045b-4351-96f4-b9fe601b234d req-cc7e8030-3c6c-442d-9da1-b5ba2a2cef33 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b5f54c53-045b-4351-96f4-b9fe601b234d req-cc7e8030-3c6c-442d-9da1-b5ba2a2cef33 service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b5f54c53-045b-4351-96f4-b9fe601b234d req-cc7e8030-3c6c-442d-9da1-b5ba2a2cef33 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b5f54c53-045b-4351-96f4-b9fe601b234d req-cc7e8030-3c6c-442d-9da1-b5ba2a2cef33 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-b5f54c53-045b-4351-96f4-b9fe601b234d req-cc7e8030-3c6c-442d-9da1-b5ba2a2cef33 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:06:34 user nova-compute[70645]: WARNING nova.compute.manager [req-b5f54c53-045b-4351-96f4-b9fe601b234d req-cc7e8030-3c6c-442d-9da1-b5ba2a2cef33 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received unexpected event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with vm_state active and task_state None.
Jul 24 15:06:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36cb1578-6f6e-46b2-8256-3af83401bc07 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.846s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-68bc3b61-3399-44fa-91b4-9b672faba36d req-2350aaca-4418-4458-b7af-975a8c0ba1c6 service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Received event network-changed-5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-68bc3b61-3399-44fa-91b4-9b672faba36d req-2350aaca-4418-4458-b7af-975a8c0ba1c6 service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Refreshing instance network info cache due to event network-changed-5db4c40e-e5fe-4aff-82c2-33a2bc44478f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-68bc3b61-3399-44fa-91b4-9b672faba36d req-2350aaca-4418-4458-b7af-975a8c0ba1c6 service nova] Acquiring lock "refresh_cache-21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-68bc3b61-3399-44fa-91b4-9b672faba36d req-2350aaca-4418-4458-b7af-975a8c0ba1c6 service nova] Acquired lock "refresh_cache-21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-68bc3b61-3399-44fa-91b4-9b672faba36d req-2350aaca-4418-4458-b7af-975a8c0ba1c6 service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Refreshing network info cache for port 5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'flavor' on Instance uuid 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:06:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Ignoring supplied device name: /dev/vdb
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:06:49 user nova-compute[70645]: INFO nova.compute.manager [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Attaching volume e81bb590-29e0-4fcb-a154-00487d8dcc54 to /dev/vdb
Jul 24 15:06:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-68bc3b61-3399-44fa-91b4-9b672faba36d req-2350aaca-4418-4458-b7af-975a8c0ba1c6 service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Updated VIF entry in instance network info cache for port 5db4c40e-e5fe-4aff-82c2-33a2bc44478f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-68bc3b61-3399-44fa-91b4-9b672faba36d req-2350aaca-4418-4458-b7af-975a8c0ba1c6 service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Updating instance_info_cache with network_info: [{"id": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "address": "fa:16:3e:c4:77:ef", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db4c40e-e5", "ovs_interfaceid": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-68bc3b61-3399-44fa-91b4-9b672faba36d req-2350aaca-4418-4458-b7af-975a8c0ba1c6 service nova] Releasing lock "refresh_cache-21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG os_brick.utils [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15ac5fe-36c6-431b-b0e1-92ab16a8f5c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1589f5-d358-4fdb-a2e8-f50e429cefb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ac7f21-a2a7-4b0e-9087-0b040dd079f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c97220b-24ab-4768-9634-ed3e8d9a3c75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:06:49 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:06:49 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c72d20-8b29-4a60-9706-9ad4fdbec70b]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG os_brick.utils [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:06:49 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Updating existing volume attachment record: 061f6628-4012-46e3-8875-806604bce298 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:06:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:06:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:06:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:06:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:06:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSzLlTHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:06:59 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:06:59 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:06:59 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6318ec-d117-4d9f-b09b-c3dd8509e7b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:06:59 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4098a9d-4491-4f09-a027-f3f004b74c51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54] added
Jul 24 15:06:59 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c266f44-7383-42a6-b568-5a06fe66d8cf]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f3d2fe-cffd-4813-991c-ae21a9c8dbd6]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSzLlTHG {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSzLlTHG" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bc93eb-2ff9-4152-8c72-98fb2dc9f62c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSzLlTHG'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ee857e-6454-495a-b608-07148334d899]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d81f21-c25f-4c2a-9db8-c2f1903737ec]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:06:59 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:06:59 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:06:59 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:06:59 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:06:59 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:06:59 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:06:59 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:06:59 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:06:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89f1990-b1c8-4d78-b4a5-955b2363d8f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54, portal: 172.16.0.220,3260]
Jul 24 15:07:00 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54, portal: 172.16.0.220,3260] successful.
Jul 24 15:07:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[36793526-5901-4b62-9c53-0b031a8daef6]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6196f3ad-3f8e-482b-a088-02efa111a563]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:00 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:00 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:07:00 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:07:00 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:00 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:00 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:07:00 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:07:00 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:00 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a1b20f-99d8-4838-b529-44f57680b197]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSzLlTHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-013c0248-5600-4846-871c-cfe1e86fa2e5 req-51accb95-1a55-4ed7-b064-514076123f9d service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-changed-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-013c0248-5600-4846-871c-cfe1e86fa2e5 req-51accb95-1a55-4ed7-b064-514076123f9d service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Refreshing instance network info cache due to event network-changed-254aef5a-c4f8-473b-a2c0-6db998ebc479. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-013c0248-5600-4846-871c-cfe1e86fa2e5 req-51accb95-1a55-4ed7-b064-514076123f9d service nova] Acquiring lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-013c0248-5600-4846-871c-cfe1e86fa2e5 req-51accb95-1a55-4ed7-b064-514076123f9d service nova] Acquired lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG nova.network.neutron [req-013c0248-5600-4846-871c-cfe1e86fa2e5 req-51accb95-1a55-4ed7-b064-514076123f9d service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Refreshing network info cache for port 254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:07:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23232653434336138', 'path': '/dev/sde'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232653434336138', 'path': '/dev/sde'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'flavor' on Instance uuid 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:07:01 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:07:01 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:07:01 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:07:01 user nova-compute[70645]:   <serial>e81bb590-29e0-4fcb-a154-00487d8dcc54</serial>
Jul 24 15:07:01 user nova-compute[70645]: </disk>
Jul 24 15:07:01 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG nova.network.neutron [req-013c0248-5600-4846-871c-cfe1e86fa2e5 req-51accb95-1a55-4ed7-b064-514076123f9d service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updated VIF entry in instance network info cache for port 254aef5a-c4f8-473b-a2c0-6db998ebc479. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG nova.network.neutron [req-013c0248-5600-4846-871c-cfe1e86fa2e5 req-51accb95-1a55-4ed7-b064-514076123f9d service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updating instance_info_cache with network_info: [{"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-013c0248-5600-4846-871c-cfe1e86fa2e5 req-51accb95-1a55-4ed7-b064-514076123f9d service nova] Releasing lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] No VIF found with MAC fa:16:3e:c4:77:ef, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:07:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7f63cfe8-83c5-4f02-af1a-cffac881361b tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.891s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG nova.compute.manager [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Stashing vm_state: active {{(pid=70645) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG nova.objects.instance [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'pci_requests' on Instance uuid 82005166-20b9-4dce-b0fe-812766f1670d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:07:02 user nova-compute[70645]: INFO nova.compute.claims [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Claim successful on node user
Jul 24 15:07:02 user nova-compute[70645]: DEBUG nova.objects.instance [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'resources' on Instance uuid 82005166-20b9-4dce-b0fe-812766f1670d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG nova.objects.instance [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'pci_devices' on Instance uuid 82005166-20b9-4dce-b0fe-812766f1670d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:02 user nova-compute[70645]: INFO nova.compute.resource_tracker [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating resource usage from migration 6e7cd619-15ed-41e7-8381-10291ad678fe
Jul 24 15:07:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-3bcb1284-3a11-4e6a-a742-e94e8debe903 req-61bf83db-e2fa-4eee-9777-70074f6d8a28 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-changed-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-3bcb1284-3a11-4e6a-a742-e94e8debe903 req-61bf83db-e2fa-4eee-9777-70074f6d8a28 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Refreshing instance network info cache due to event network-changed-55ec9ae6-b6b7-4768-96b8-fe5fafed148f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3bcb1284-3a11-4e6a-a742-e94e8debe903 req-61bf83db-e2fa-4eee-9777-70074f6d8a28 service nova] Acquiring lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3bcb1284-3a11-4e6a-a742-e94e8debe903 req-61bf83db-e2fa-4eee-9777-70074f6d8a28 service nova] Acquired lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG nova.network.neutron [req-3bcb1284-3a11-4e6a-a742-e94e8debe903 req-61bf83db-e2fa-4eee-9777-70074f6d8a28 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Refreshing network info cache for port 55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:07:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.674s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:02 user nova-compute[70645]: INFO nova.compute.manager [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Migrating
Jul 24 15:07:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:07:03 user nova-compute[70645]: DEBUG nova.network.neutron [req-3bcb1284-3a11-4e6a-a742-e94e8debe903 req-61bf83db-e2fa-4eee-9777-70074f6d8a28 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updated VIF entry in instance network info cache for port 55ec9ae6-b6b7-4768-96b8-fe5fafed148f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:07:03 user nova-compute[70645]: DEBUG nova.network.neutron [req-3bcb1284-3a11-4e6a-a742-e94e8debe903 req-61bf83db-e2fa-4eee-9777-70074f6d8a28 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating instance_info_cache with network_info: [{"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3bcb1284-3a11-4e6a-a742-e94e8debe903 req-61bf83db-e2fa-4eee-9777-70074f6d8a28 service nova] Releasing lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:07:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquired lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:07:03 user nova-compute[70645]: DEBUG nova.network.neutron [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:07:03 user nova-compute[70645]: DEBUG nova.network.neutron [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating instance_info_cache with network_info: [{"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Releasing lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:07:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Starting migrate_disk_and_power_off {{(pid=70645) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Instance destroyed successfully.
Jul 24 15:07:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1826590044',display_name='tempest-ServerActionsTestOtherA-server-1826590044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1826590044',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-dqgn0mql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=82005166-20b9-4dce-b0fe-812766f1670d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-577354223-network", "vif_mac": "fa:16:3e:d8:fb:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-577354223-network", "vif_mac": "fa:16:3e:d8:fb:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_vif [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55ec9ae6-b6, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:07:04 user nova-compute[70645]: INFO os_vif [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6')
Jul 24 15:07:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXEtuKaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:07:04 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1286f349-7fae-4ec1-9c12-448cd307d397]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b77845-4b25-4f0b-a922-0c7b69e178e7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:04 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:04 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:07:04 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:07:04 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:04 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:04 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:04 user nova-compute[70645]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:07:04 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:07:04 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:04 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbaa1cc1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac947b35-50a3-4241-a511-c6597bf6ecee]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-vif-unplugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] No waiting events found dispatching network-vif-unplugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:04 user nova-compute[70645]: WARNING nova.compute.manager [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received unexpected event network-vif-unplugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f for instance with vm_state active and task_state resize_migrating.
Jul 24 15:07:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] No waiting events found dispatching network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:04 user nova-compute[70645]: WARNING nova.compute.manager [req-f1504092-939a-43d1-9a6f-e892fdeacb4c req-4314497b-a08e-438c-a9af-6e0abdd16442 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received unexpected event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f for instance with vm_state active and task_state resize_migrating.
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[057b28f7-4bf4-4513-84ae-7cde1e3a09ce]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3615082-27c0-40c5-9135-178964930aec]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0abe65-68d1-463d-81a6-8750cc6bfe54]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:07:04 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[de737913-ae1d-46dc-aa36-ac181a59e289]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7995600b-8ba7-4835-9911-6283ce4cb982]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260]
Jul 24 15:07:05 user nova-compute[70645]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260] successful.
Jul 24 15:07:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a46dda6-a4a2-47ba-82ab-c546cc895a58]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== disconnect_volume: return (360ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:07:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:07:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:06 user nova-compute[70645]: INFO nova.compute.manager [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Detaching volume 087aa622-8e57-46e5-bd74-fae2d812a9c4
Jul 24 15:07:06 user nova-compute[70645]: INFO nova.virt.block_device [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Attempting to driver detach volume 087aa622-8e57-46e5-bd74-fae2d812a9c4 from mountpoint /dev/vdb
Jul 24 15:07:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Attempting to detach device vdb from instance 8ad33774-2d1b-480d-871d-f422c941c806 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:07:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:07:06 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:07:06 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:07:06 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:07:06 user nova-compute[70645]:   <serial>087aa622-8e57-46e5-bd74-fae2d812a9c4</serial>
Jul 24 15:07:06 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:07:06 user nova-compute[70645]: </disk>
Jul 24 15:07:06 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:07:06 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Successfully detached device vdb from instance 8ad33774-2d1b-480d-871d-f422c941c806 from the persistent domain config.
Jul 24 15:07:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8ad33774-2d1b-480d-871d-f422c941c806 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:07:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:07:06 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:07:06 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:07:06 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:07:06 user nova-compute[70645]:   <serial>087aa622-8e57-46e5-bd74-fae2d812a9c4</serial>
Jul 24 15:07:06 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:07:06 user nova-compute[70645]: </disk>
Jul 24 15:07:06 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:07:06 user nova-compute[70645]: DEBUG nova.network.neutron [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Port 55ec9ae6-b6b7-4768-96b8-fe5fafed148f binding to destination host user is already ACTIVE {{(pid=70645) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211227.0337014, 8ad33774-2d1b-480d-871d-f422c941c806 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8ad33774-2d1b-480d-871d-f422c941c806 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:07:07 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Successfully detached device vdb from instance 8ad33774-2d1b-480d-871d-f422c941c806 from the live domain config.
Jul 24 15:07:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNTMvPLk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:07:07 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a9b929-e3c6-431c-a7f4-d7dbd3f43f3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8390b6ae-cecb-42bf-9168-e053943d8d3a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:07 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:07 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:07:07 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:07 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:07 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:07 user nova-compute[70645]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 (non-flash)
Jul 24 15:07:07 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:07 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba84296440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquired lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG nova.network.neutron [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe15832-1280-4dc8-9733-d6ea04f1d664]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7560a2-b44f-4b30-b113-6a204d257f56]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[89df635e-e536-42dc-b34d-c851e924b795]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a01a695-981a-4fa8-89a4-828522688395]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca392f2e-1eff-43e6-aa9d-8d2653057974]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5a6b6c-d439-48fc-a236-905d5f6d7932]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4, portal: 172.16.0.220,3260]
Jul 24 15:07:07 user nova-compute[70645]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4, portal: 172.16.0.220,3260] successful.
Jul 24 15:07:07 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087aa622-8e57-46e5-bd74-fae2d812a9c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ad6a09-8119-406f-b51b-aaae8364c871]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] <== disconnect_volume: return (317ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG nova.network.neutron [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating instance_info_cache with network_info: [{"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Releasing lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.utils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea725be5-886f-47c7-9927-2db07b140692]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fc6c3b-8042-4231-b2d7-03d49ce71f5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b864ff1-1bba-43b4-ac51-06b3d63f7310]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef49ae9-226b-4c4e-8c8e-bb4e41f2de36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:07:07 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:07:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[896ca741-48e6-49fe-a0df-b5f415353ffb]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:07:07 user nova-compute[70645]: DEBUG os_brick.utils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:07:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:09 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lazy-loading 'flavor' on Instance uuid 8ad33774-2d1b-480d-871d-f422c941c806 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cba5472-4f6d-4239-afae-894bbfbfa4fd tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.479s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:19 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211224.7699704, 82005166-20b9-4dce-b0fe-812766f1670d => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:07:19 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] VM Stopped (Lifecycle Event)
Jul 24 15:07:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-12af3421-5a4c-45eb-8703-6304b7c82907 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:07:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-12af3421-5a4c-45eb-8703-6304b7c82907 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:07:19 user nova-compute[70645]: INFO nova.compute.manager [None req-12af3421-5a4c-45eb-8703-6304b7c82907 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 15:07:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "b88eed64-1249-4a30-b881-29e5ac81d9a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:21 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:07:21 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:07:21 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:07:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:07:21 user nova-compute[70645]: INFO nova.compute.claims [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Claim successful on node user
Jul 24 15:07:22 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.755s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:07:22 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:07:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:07:22 user nova-compute[70645]: DEBUG nova.policy [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7baae1cced074129abc9c7e46a69001e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2a4081bd346928d0e316e7e856479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:07:23 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Creating image(s)
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "/opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "/opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "/opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.159s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Starting finish_migration {{(pid=70645) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Instance directory exists: not creating {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 15:07:23 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Creating image(s)
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Ensure instance console log exists: /opt/stack/data/nova/instances/82005166-20b9-4dce-b0fe-812766f1670d/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Start _get_guest_xml network_info=[{"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-577354223-network", "vif_mac": "fa:16:3e:d8:fb:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fbb4d1bd-7543-42b8-9f24-48f8279d19ef', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXEtuKaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '82005166-20b9-4dce-b0fe-812766f1670d', 'attached_at': '2023-07-24T15:07:23.000000', 'detached_at': '', 'volume_id': '698cf0df-4652-47eb-ba65-289eec42a6fc', 'serial': '698cf0df-4652-47eb-ba65-289eec42a6fc'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:07:23 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:07:23 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.objects.instance [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'vcpu_model' on Instance uuid 82005166-20b9-4dce-b0fe-812766f1670d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXEtuKaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:07:23 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:07:23 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:07:23 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.164s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[59044be4-429b-4bea-83d6-33d2ae63612a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:07:23 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk 1073741824" returned: 0 in 0.093s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d34cb5-5ec0-410a-a005-2ce0643e6c54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc] added
Jul 24 15:07:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[db382361-b81d-4841-b392-2d793fcb9789]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88fb574-6133-4e11-8d7c-2a604bca52ec]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXEtuKaW {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXEtuKaW" returned: 0 in 0.033s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f3384e-e003-4dbb-b12f-d5f222c1011d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QXEtuKaW'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.175s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d321d9-087b-456d-994b-776959d637b7]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Successfully created port: 14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cc09da-765f-4ad5-8064-4d267e2d3a33]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7044c195-3d7a-4af7-8d9d-8b8ca38e5e7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260]
Jul 24 15:07:23 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260] successful.
Jul 24 15:07:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Cannot resize image /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.objects.instance [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lazy-loading 'migration_context' on Instance uuid b88eed64-1249-4a30-b881-29e5ac81d9a3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3df6f6-e025-42fc-8b1c-4231fe9dfef1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Ensure instance console log exists: /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c7f064-2e79-4adf-83a2-3fe9b290b755]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:07:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:23 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:07:23 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.515s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[241a2198-84d5-47cd-a994-43bd99a96fb3]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXEtuKaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Successfully updated port: 14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.compute.manager [req-95b0455c-e058-4934-8235-f7129361c361 req-23fcac2b-b796-4ff2-bdd7-f05907f8910b service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Received event network-changed-14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.compute.manager [req-95b0455c-e058-4934-8235-f7129361c361 req-23fcac2b-b796-4ff2-bdd7-f05907f8910b service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Refreshing instance network info cache due to event network-changed-14f7703a-68ce-44b2-b928-3b5ae34855e1. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-95b0455c-e058-4934-8235-f7129361c361 req-23fcac2b-b796-4ff2-bdd7-f05907f8910b service nova] Acquiring lock "refresh_cache-b88eed64-1249-4a30-b881-29e5ac81d9a3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-95b0455c-e058-4934-8235-f7129361c361 req-23fcac2b-b796-4ff2-bdd7-f05907f8910b service nova] Acquired lock "refresh_cache-b88eed64-1249-4a30-b881-29e5ac81d9a3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.network.neutron [req-95b0455c-e058-4934-8235-f7129361c361 req-23fcac2b-b796-4ff2-bdd7-f05907f8910b service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Refreshing network info cache for port 14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "refresh_cache-b88eed64-1249-4a30-b881-29e5ac81d9a3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.network.neutron [req-95b0455c-e058-4934-8235-f7129361c361 req-23fcac2b-b796-4ff2-bdd7-f05907f8910b service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.network.neutron [req-95b0455c-e058-4934-8235-f7129361c361 req-23fcac2b-b796-4ff2-bdd7-f05907f8910b service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-95b0455c-e058-4934-8235-f7129361c361 req-23fcac2b-b796-4ff2-bdd7-f05907f8910b service nova] Releasing lock "refresh_cache-b88eed64-1249-4a30-b881-29e5ac81d9a3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquired lock "refresh_cache-b88eed64-1249-4a30-b881-29e5ac81d9a3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.561s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== connect_volume: return (1563ms) {'type': 'block', 'scsi_wwn': '26466643639633734', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466643639633734', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1826590044',display_name='tempest-ServerActionsTestOtherA-server-1826590044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1826590044',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-dqgn0mql',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=82005166-20b9-4dce-b0fe-812766f1670d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-577354223-network", "vif_mac": "fa:16:3e:d8:fb:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-577354223-network", "vif_mac": "fa:16:3e:d8:fb:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:07:24 user nova-compute[70645]:   <uuid>82005166-20b9-4dce-b0fe-812766f1670d</uuid>
Jul 24 15:07:24 user nova-compute[70645]:   <name>instance-0000001d</name>
Jul 24 15:07:24 user nova-compute[70645]:   <memory>2097152</memory>
Jul 24 15:07:24 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:07:24 user nova-compute[70645]:   <metadata>
Jul 24 15:07:24 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:07:24 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:07:24 user nova-compute[70645]:       <nova:name>tempest-ServerActionsTestOtherA-server-1826590044</nova:name>
Jul 24 15:07:24 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:07:23</nova:creationTime>
Jul 24 15:07:24 user nova-compute[70645]:       <nova:flavor name="m1.small">
Jul 24 15:07:24 user nova-compute[70645]:         <nova:memory>2048</nova:memory>
Jul 24 15:07:24 user nova-compute[70645]:         <nova:disk>20</nova:disk>
Jul 24 15:07:24 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:07:24 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:07:24 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:07:24 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:07:24 user nova-compute[70645]:       <nova:owner>
Jul 24 15:07:24 user nova-compute[70645]:         <nova:user uuid="43cd7067d09747f9b80cec22154a0e93">tempest-ServerActionsTestOtherA-1886739574-project-member</nova:user>
Jul 24 15:07:24 user nova-compute[70645]:         <nova:project uuid="f863d6c0aad845139d04b550254d59e3">tempest-ServerActionsTestOtherA-1886739574</nova:project>
Jul 24 15:07:24 user nova-compute[70645]:       </nova:owner>
Jul 24 15:07:24 user nova-compute[70645]:       <nova:ports>
Jul 24 15:07:24 user nova-compute[70645]:         <nova:port uuid="55ec9ae6-b6b7-4768-96b8-fe5fafed148f">
Jul 24 15:07:24 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 15:07:24 user nova-compute[70645]:         </nova:port>
Jul 24 15:07:24 user nova-compute[70645]:       </nova:ports>
Jul 24 15:07:24 user nova-compute[70645]:     </nova:instance>
Jul 24 15:07:24 user nova-compute[70645]:   </metadata>
Jul 24 15:07:24 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:07:24 user nova-compute[70645]:     <system>
Jul 24 15:07:24 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:07:24 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:07:24 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:07:24 user nova-compute[70645]:       <entry name="serial">82005166-20b9-4dce-b0fe-812766f1670d</entry>
Jul 24 15:07:24 user nova-compute[70645]:       <entry name="uuid">82005166-20b9-4dce-b0fe-812766f1670d</entry>
Jul 24 15:07:24 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:07:24 user nova-compute[70645]:     </system>
Jul 24 15:07:24 user nova-compute[70645]:   </sysinfo>
Jul 24 15:07:24 user nova-compute[70645]:   <os>
Jul 24 15:07:24 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:07:24 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:07:24 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:07:24 user nova-compute[70645]:   </os>
Jul 24 15:07:24 user nova-compute[70645]:   <features>
Jul 24 15:07:24 user nova-compute[70645]:     <acpi/>
Jul 24 15:07:24 user nova-compute[70645]:     <apic/>
Jul 24 15:07:24 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:07:24 user nova-compute[70645]:   </features>
Jul 24 15:07:24 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:07:24 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:07:24 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:07:24 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:07:24 user nova-compute[70645]:   </clock>
Jul 24 15:07:24 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:07:24 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:07:24 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:07:24 user nova-compute[70645]:   </cpu>
Jul 24 15:07:24 user nova-compute[70645]:   <devices>
Jul 24 15:07:24 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:07:24 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:07:24 user nova-compute[70645]:       <source dev="/dev/sdb"/>
Jul 24 15:07:24 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:07:24 user nova-compute[70645]:       <serial>698cf0df-4652-47eb-ba65-289eec42a6fc</serial>
Jul 24 15:07:24 user nova-compute[70645]:     </disk>
Jul 24 15:07:24 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:07:24 user nova-compute[70645]:       <mac address="fa:16:3e:d8:fb:57"/>
Jul 24 15:07:24 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:07:24 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:07:24 user nova-compute[70645]:       <target dev="tap55ec9ae6-b6"/>
Jul 24 15:07:24 user nova-compute[70645]:     </interface>
Jul 24 15:07:24 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:07:24 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/82005166-20b9-4dce-b0fe-812766f1670d/console.log" append="off"/>
Jul 24 15:07:24 user nova-compute[70645]:     </serial>
Jul 24 15:07:24 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:07:24 user nova-compute[70645]:     <video>
Jul 24 15:07:24 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:07:24 user nova-compute[70645]:     </video>
Jul 24 15:07:24 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:07:24 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:07:24 user nova-compute[70645]:     </rng>
Jul 24 15:07:24 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:07:24 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:07:24 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:07:24 user nova-compute[70645]:     </memballoon>
Jul 24 15:07:24 user nova-compute[70645]:   </devices>
Jul 24 15:07:24 user nova-compute[70645]: </domain>
Jul 24 15:07:24 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1826590044',display_name='tempest-ServerActionsTestOtherA-server-1826590044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1826590044',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-dqgn0mql',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=82005166-20b9-4dce-b0fe-812766f1670d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-577354223-network", "vif_mac": "fa:16:3e:d8:fb:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-577354223-network", "vif_mac": "fa:16:3e:d8:fb:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG os_vif [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:07:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55ec9ae6-b6, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55ec9ae6-b6, col_values=(('external_ids', {'iface-id': '55ec9ae6-b6b7-4768-96b8-fe5fafed148f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:fb:57', 'vm-uuid': '82005166-20b9-4dce-b0fe-812766f1670d'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:25 user nova-compute[70645]: INFO os_vif [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6')
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] No VIF found with MAC fa:16:3e:d8:fb:57, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Updating instance_info_cache with network_info: [{"id": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "address": "fa:16:3e:00:e6:c9", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f7703a-68", "ovs_interfaceid": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Releasing lock "refresh_cache-b88eed64-1249-4a30-b881-29e5ac81d9a3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Instance network_info: |[{"id": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "address": "fa:16:3e:00:e6:c9", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f7703a-68", "ovs_interfaceid": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Start _get_guest_xml network_info=[{"id": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "address": "fa:16:3e:00:e6:c9", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f7703a-68", "ovs_interfaceid": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:07:25 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:07:25 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1335537879',display_name='tempest-ServersNegativeTestJSON-server-1335537879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1335537879',id=33,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3f2a4081bd346928d0e316e7e856479',ramdisk_id='',reservation_id='r-cd6otexj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-118608074',owner_user_name='tempest-ServersNegativeTestJSON-118608074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:07:23Z,user_data=None,user_id='7baae1cced074129abc9c7e46a69001e',uuid=b88eed64-1249-4a30-b881-29e5ac81d9a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "address": "fa:16:3e:00:e6:c9", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f7703a-68", "ovs_interfaceid": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converting VIF {"id": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "address": "fa:16:3e:00:e6:c9", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f7703a-68", "ovs_interfaceid": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:e6:c9,bridge_name='br-int',has_traffic_filtering=True,id=14f7703a-68ce-44b2-b928-3b5ae34855e1,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f7703a-68') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.objects.instance [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lazy-loading 'pci_devices' on Instance uuid b88eed64-1249-4a30-b881-29e5ac81d9a3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:07:25 user nova-compute[70645]:   <uuid>b88eed64-1249-4a30-b881-29e5ac81d9a3</uuid>
Jul 24 15:07:25 user nova-compute[70645]:   <name>instance-00000021</name>
Jul 24 15:07:25 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:07:25 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:07:25 user nova-compute[70645]:   <metadata>
Jul 24 15:07:25 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:07:25 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:07:25 user nova-compute[70645]:       <nova:name>tempest-ServersNegativeTestJSON-server-1335537879</nova:name>
Jul 24 15:07:25 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:07:25</nova:creationTime>
Jul 24 15:07:25 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:07:25 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:07:25 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:07:25 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:07:25 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:07:25 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:07:25 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:07:25 user nova-compute[70645]:       <nova:owner>
Jul 24 15:07:25 user nova-compute[70645]:         <nova:user uuid="7baae1cced074129abc9c7e46a69001e">tempest-ServersNegativeTestJSON-118608074-project-member</nova:user>
Jul 24 15:07:25 user nova-compute[70645]:         <nova:project uuid="e3f2a4081bd346928d0e316e7e856479">tempest-ServersNegativeTestJSON-118608074</nova:project>
Jul 24 15:07:25 user nova-compute[70645]:       </nova:owner>
Jul 24 15:07:25 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:07:25 user nova-compute[70645]:       <nova:ports>
Jul 24 15:07:25 user nova-compute[70645]:         <nova:port uuid="14f7703a-68ce-44b2-b928-3b5ae34855e1">
Jul 24 15:07:25 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 15:07:25 user nova-compute[70645]:         </nova:port>
Jul 24 15:07:25 user nova-compute[70645]:       </nova:ports>
Jul 24 15:07:25 user nova-compute[70645]:     </nova:instance>
Jul 24 15:07:25 user nova-compute[70645]:   </metadata>
Jul 24 15:07:25 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:07:25 user nova-compute[70645]:     <system>
Jul 24 15:07:25 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:07:25 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:07:25 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:07:25 user nova-compute[70645]:       <entry name="serial">b88eed64-1249-4a30-b881-29e5ac81d9a3</entry>
Jul 24 15:07:25 user nova-compute[70645]:       <entry name="uuid">b88eed64-1249-4a30-b881-29e5ac81d9a3</entry>
Jul 24 15:07:25 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:07:25 user nova-compute[70645]:     </system>
Jul 24 15:07:25 user nova-compute[70645]:   </sysinfo>
Jul 24 15:07:25 user nova-compute[70645]:   <os>
Jul 24 15:07:25 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:07:25 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:07:25 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:07:25 user nova-compute[70645]:   </os>
Jul 24 15:07:25 user nova-compute[70645]:   <features>
Jul 24 15:07:25 user nova-compute[70645]:     <acpi/>
Jul 24 15:07:25 user nova-compute[70645]:     <apic/>
Jul 24 15:07:25 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:07:25 user nova-compute[70645]:   </features>
Jul 24 15:07:25 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:07:25 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:07:25 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:07:25 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:07:25 user nova-compute[70645]:   </clock>
Jul 24 15:07:25 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:07:25 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:07:25 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:07:25 user nova-compute[70645]:   </cpu>
Jul 24 15:07:25 user nova-compute[70645]:   <devices>
Jul 24 15:07:25 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:07:25 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:07:25 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk"/>
Jul 24 15:07:25 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:07:25 user nova-compute[70645]:     </disk>
Jul 24 15:07:25 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:07:25 user nova-compute[70645]:       <mac address="fa:16:3e:00:e6:c9"/>
Jul 24 15:07:25 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:07:25 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:07:25 user nova-compute[70645]:       <target dev="tap14f7703a-68"/>
Jul 24 15:07:25 user nova-compute[70645]:     </interface>
Jul 24 15:07:25 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:07:25 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/console.log" append="off"/>
Jul 24 15:07:25 user nova-compute[70645]:     </serial>
Jul 24 15:07:25 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:07:25 user nova-compute[70645]:     <video>
Jul 24 15:07:25 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:07:25 user nova-compute[70645]:     </video>
Jul 24 15:07:25 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:07:25 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:07:25 user nova-compute[70645]:     </rng>
Jul 24 15:07:25 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:07:25 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:07:25 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:07:25 user nova-compute[70645]:     </memballoon>
Jul 24 15:07:25 user nova-compute[70645]:   </devices>
Jul 24 15:07:25 user nova-compute[70645]: </domain>
Jul 24 15:07:25 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1335537879',display_name='tempest-ServersNegativeTestJSON-server-1335537879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1335537879',id=33,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3f2a4081bd346928d0e316e7e856479',ramdisk_id='',reservation_id='r-cd6otexj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-118608074',owner_user_name='tempest-ServersNegativeTestJSON-118608074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:07:23Z,user_data=None,user_id='7baae1cced074129abc9c7e46a69001e',uuid=b88eed64-1249-4a30-b881-29e5ac81d9a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "address": "fa:16:3e:00:e6:c9", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f7703a-68", "ovs_interfaceid": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converting VIF {"id": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "address": "fa:16:3e:00:e6:c9", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f7703a-68", "ovs_interfaceid": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:e6:c9,bridge_name='br-int',has_traffic_filtering=True,id=14f7703a-68ce-44b2-b928-3b5ae34855e1,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f7703a-68') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG os_vif [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:e6:c9,bridge_name='br-int',has_traffic_filtering=True,id=14f7703a-68ce-44b2-b928-3b5ae34855e1,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f7703a-68') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14f7703a-68, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14f7703a-68, col_values=(('external_ids', {'iface-id': '14f7703a-68ce-44b2-b928-3b5ae34855e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:e6:c9', 'vm-uuid': 'b88eed64-1249-4a30-b881-29e5ac81d9a3'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:25 user nova-compute[70645]: INFO os_vif [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:e6:c9,bridge_name='br-int',has_traffic_filtering=True,id=14f7703a-68ce-44b2-b928-3b5ae34855e1,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f7703a-68')
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] No VIF found with MAC fa:16:3e:00:e6:c9, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:27 user nova-compute[70645]: DEBUG nova.compute.manager [req-b1f7e56b-f123-418b-ba2a-ecbbb0bc03bd req-de082462-a5f4-4262-902b-420029d02ce5 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b1f7e56b-f123-418b-ba2a-ecbbb0bc03bd req-de082462-a5f4-4262-902b-420029d02ce5 service nova] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b1f7e56b-f123-418b-ba2a-ecbbb0bc03bd req-de082462-a5f4-4262-902b-420029d02ce5 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b1f7e56b-f123-418b-ba2a-ecbbb0bc03bd req-de082462-a5f4-4262-902b-420029d02ce5 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:27 user nova-compute[70645]: DEBUG nova.compute.manager [req-b1f7e56b-f123-418b-ba2a-ecbbb0bc03bd req-de082462-a5f4-4262-902b-420029d02ce5 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] No waiting events found dispatching network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:27 user nova-compute[70645]: WARNING nova.compute.manager [req-b1f7e56b-f123-418b-ba2a-ecbbb0bc03bd req-de082462-a5f4-4262-902b-420029d02ce5 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received unexpected event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f for instance with vm_state active and task_state resize_finish.
Jul 24 15:07:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211250.2675674, 82005166-20b9-4dce-b0fe-812766f1670d => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:07:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] VM Resumed (Lifecycle Event)
Jul 24 15:07:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-21aa58ff-43c6-42c9-96aa-728f85336524 req-0b0c6d9f-ddb8-424f-a529-a96e5aace8ff service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Received event network-vif-plugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-21aa58ff-43c6-42c9-96aa-728f85336524 req-0b0c6d9f-ddb8-424f-a529-a96e5aace8ff service nova] Acquiring lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-21aa58ff-43c6-42c9-96aa-728f85336524 req-0b0c6d9f-ddb8-424f-a529-a96e5aace8ff service nova] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-21aa58ff-43c6-42c9-96aa-728f85336524 req-0b0c6d9f-ddb8-424f-a529-a96e5aace8ff service nova] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-21aa58ff-43c6-42c9-96aa-728f85336524 req-0b0c6d9f-ddb8-424f-a529-a96e5aace8ff service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] No waiting events found dispatching network-vif-plugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:30 user nova-compute[70645]: WARNING nova.compute.manager [req-21aa58ff-43c6-42c9-96aa-728f85336524 req-0b0c6d9f-ddb8-424f-a529-a96e5aace8ff service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Received unexpected event network-vif-plugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 for instance with vm_state building and task_state spawning.
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-f9ca7dda-bcf7-4aea-86b4-db8b404c4160 req-0d913540-4243-48ce-a7bc-f8e1d87a2d4b service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f9ca7dda-bcf7-4aea-86b4-db8b404c4160 req-0d913540-4243-48ce-a7bc-f8e1d87a2d4b service nova] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f9ca7dda-bcf7-4aea-86b4-db8b404c4160 req-0d913540-4243-48ce-a7bc-f8e1d87a2d4b service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f9ca7dda-bcf7-4aea-86b4-db8b404c4160 req-0d913540-4243-48ce-a7bc-f8e1d87a2d4b service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-f9ca7dda-bcf7-4aea-86b4-db8b404c4160 req-0d913540-4243-48ce-a7bc-f8e1d87a2d4b service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] No waiting events found dispatching network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:30 user nova-compute[70645]: WARNING nova.compute.manager [req-f9ca7dda-bcf7-4aea-86b4-db8b404c4160 req-0d913540-4243-48ce-a7bc-f8e1d87a2d4b service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received unexpected event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f for instance with vm_state active and task_state resize_finish.
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-4f864e29-5ee2-42ed-86e0-23c63b08d254 req-7b65544e-49d4-45a5-99bf-10d12504e151 service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Received event network-vif-plugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4f864e29-5ee2-42ed-86e0-23c63b08d254 req-7b65544e-49d4-45a5-99bf-10d12504e151 service nova] Acquiring lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4f864e29-5ee2-42ed-86e0-23c63b08d254 req-7b65544e-49d4-45a5-99bf-10d12504e151 service nova] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4f864e29-5ee2-42ed-86e0-23c63b08d254 req-7b65544e-49d4-45a5-99bf-10d12504e151 service nova] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-4f864e29-5ee2-42ed-86e0-23c63b08d254 req-7b65544e-49d4-45a5-99bf-10d12504e151 service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] No waiting events found dispatching network-vif-plugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:30 user nova-compute[70645]: WARNING nova.compute.manager [req-4f864e29-5ee2-42ed-86e0-23c63b08d254 req-7b65544e-49d4-45a5-99bf-10d12504e151 service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Received unexpected event network-vif-plugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 for instance with vm_state building and task_state spawning.
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Instance running successfully.
Jul 24 15:07:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Instance spawned successfully.
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:07:30 user nova-compute[70645]: INFO nova.compute.manager [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Detaching volume e81bb590-29e0-4fcb-a154-00487d8dcc54
Jul 24 15:07:30 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:07:30 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7012MB free_disk=25.168609619140625GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Failed to set time: agent not configured {{(pid=70645) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-241adff0-9c3f-4de0-810c-ac8121575f90 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] finish_migration finished successfully. {{(pid=70645) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:07:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211250.268565, 82005166-20b9-4dce-b0fe-812766f1670d => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:07:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] VM Started (Lifecycle Event)
Jul 24 15:07:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:31 user nova-compute[70645]: INFO nova.virt.block_device [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Attempting to driver detach volume e81bb590-29e0-4fcb-a154-00487d8dcc54 from mountpoint /dev/vdb
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Attempting to detach device vdb from instance 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:07:31 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:07:31 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:07:31 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:07:31 user nova-compute[70645]:   <serial>e81bb590-29e0-4fcb-a154-00487d8dcc54</serial>
Jul 24 15:07:31 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:07:31 user nova-compute[70645]: </disk>
Jul 24 15:07:31 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:07:31 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211250.529768, b88eed64-1249-4a30-b881-29e5ac81d9a3 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:07:31 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] VM Resumed (Lifecycle Event)
Jul 24 15:07:31 user nova-compute[70645]: INFO nova.compute.manager [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Took 8.05 seconds to spawn the instance on the hypervisor.
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:31 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Successfully detached device vdb from instance 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e from the persistent domain config.
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:07:31 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:07:31 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:07:31 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:07:31 user nova-compute[70645]:   <serial>e81bb590-29e0-4fcb-a154-00487d8dcc54</serial>
Jul 24 15:07:31 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:07:31 user nova-compute[70645]: </disk>
Jul 24 15:07:31 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Applying migration context for instance 82005166-20b9-4dce-b0fe-812766f1670d as it has an incoming, in-progress migration 6e7cd619-15ed-41e7-8381-10291ad678fe. Migration status is finished {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 15:07:31 user nova-compute[70645]: INFO nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating resource usage from migration 6e7cd619-15ed-41e7-8381-10291ad678fe
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:07:31 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211250.5327008, b88eed64-1249-4a30-b881-29e5ac81d9a3 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:07:31 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] VM Started (Lifecycle Event)
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 734abf9a-96dd-40b4-9b68-2d42fa079216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 07adce07-b416-44fb-b548-17b8cd0d8168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 8ad33774-2d1b-480d-871d-f422c941c806 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 4f686b79-b22d-4453-ae35-7a1133d7aa86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 50dc20e7-65ef-4743-8707-9ef7da98f947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Migration 6e7cd619-15ed-41e7-8381-10291ad678fe is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 82005166-20b9-4dce-b0fe-812766f1670d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b88eed64-1249-4a30-b881-29e5ac81d9a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:07:31 user nova-compute[70645]: INFO nova.compute.manager [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Took 9.31 seconds to build instance.
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa25b092-6e2d-46ec-9ab4-07439243bd51 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.434s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211251.6308503, 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:07:31 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Successfully detached device vdb from instance 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e from the live domain config.
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSzLlTHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:07:31 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[461cb97e-eaae-4c2f-86f8-962a3bef8757]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae54aa6f-2986-4797-ae6c-ccb0dffee715]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:31 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:31 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:31 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:07:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:31 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:31 user nova-compute[70645]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 (non-flash)
Jul 24 15:07:31 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:07:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba8467b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54'): ({'sde'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Removing single pathed devices sde {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e7a590-f711-429d-98b8-ac53d304dd2e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30bff3c-6cab-44c2-b15e-76429e204dfe]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Flushing IO for device /dev/sde {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3927c4a-08d1-4845-a47e-de80183de900]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f0dc7-fc1b-472e-b660-c1d5f60c143a]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] SCSI volumes sde have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[802b8352-b03d-4080-ac0f-3c48bf98a356]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.100s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4583639-3a5f-4f99-9a60-9e6773ae5314]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54, portal: 172.16.0.220,3260]
Jul 24 15:07:31 user nova-compute[70645]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54, portal: 172.16.0.220,3260] successful.
Jul 24 15:07:31 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[29637dc9-4889-4b22-a73c-a51bc73e6159]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] <== disconnect_volume: return (387ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-3dd4ef3f-4158-4956-bf05-6dfa9bb9830e req-67c36940-fd44-4f55-af2e-ad6a43d51b7b service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-changed-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-3dd4ef3f-4158-4956-bf05-6dfa9bb9830e req-67c36940-fd44-4f55-af2e-ad6a43d51b7b service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Refreshing instance network info cache due to event network-changed-65f3b461-6fb6-4333-a140-5935cdbed714. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3dd4ef3f-4158-4956-bf05-6dfa9bb9830e req-67c36940-fd44-4f55-af2e-ad6a43d51b7b service nova] Acquiring lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3dd4ef3f-4158-4956-bf05-6dfa9bb9830e req-67c36940-fd44-4f55-af2e-ad6a43d51b7b service nova] Acquired lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG nova.network.neutron [req-3dd4ef3f-4158-4956-bf05-6dfa9bb9830e req-67c36940-fd44-4f55-af2e-ad6a43d51b7b service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Refreshing network info cache for port 65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG nova.network.neutron [req-3dd4ef3f-4158-4956-bf05-6dfa9bb9830e req-67c36940-fd44-4f55-af2e-ad6a43d51b7b service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updated VIF entry in instance network info cache for port 65f3b461-6fb6-4333-a140-5935cdbed714. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG nova.network.neutron [req-3dd4ef3f-4158-4956-bf05-6dfa9bb9830e req-67c36940-fd44-4f55-af2e-ad6a43d51b7b service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updating instance_info_cache with network_info: [{"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3dd4ef3f-4158-4956-bf05-6dfa9bb9830e req-67c36940-fd44-4f55-af2e-ad6a43d51b7b service nova] Releasing lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'flavor' on Instance uuid 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d5c746d7-3ba0-4307-81d7-47dc414d8646 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.261s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.259s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:33 user nova-compute[70645]: INFO nova.compute.manager [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Terminating instance
Jul 24 15:07:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:33 user nova-compute[70645]: INFO nova.compute.manager [None req-85590d7c-d695-47c4-bea8-3c35f3afe1dd tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Unrescuing
Jul 24 15:07:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-85590d7c-d695-47c4-bea8-3c35f3afe1dd tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-85590d7c-d695-47c4-bea8-3c35f3afe1dd tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquired lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG nova.network.neutron [None req-85590d7c-d695-47c4-bea8-3c35f3afe1dd tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-a90cc447-96af-4677-9606-75ced9cd665e req-7f25a30e-8ab3-4a82-a263-9b5322842380 service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Received event network-vif-unplugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a90cc447-96af-4677-9606-75ced9cd665e req-7f25a30e-8ab3-4a82-a263-9b5322842380 service nova] Acquiring lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a90cc447-96af-4677-9606-75ced9cd665e req-7f25a30e-8ab3-4a82-a263-9b5322842380 service nova] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a90cc447-96af-4677-9606-75ced9cd665e req-7f25a30e-8ab3-4a82-a263-9b5322842380 service nova] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-a90cc447-96af-4677-9606-75ced9cd665e req-7f25a30e-8ab3-4a82-a263-9b5322842380 service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] No waiting events found dispatching network-vif-unplugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-a90cc447-96af-4677-9606-75ced9cd665e req-7f25a30e-8ab3-4a82-a263-9b5322842380 service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Received event network-vif-unplugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:07:33 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Instance destroyed successfully.
Jul 24 15:07:33 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lazy-loading 'resources' on Instance uuid 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:04:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-503794527',display_name='tempest-VolumesSnapshotTestJSON-instance-503794527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-503794527',id=28,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTa4gwabuPNtKe6tm4gcamWd3VcC2VKsMuYX0Ep9APf8uGNQh4cL06TLre3rqr6NOi6LfNDyAYMPUTf68B/Q4HCtn4saVfrML/W/TLG4As3b86FvBV4JkbvpHr1XfXkaA==',key_name='tempest-keypair-205122020',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:05:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f2edf2107c94e1195d57905b59344fb',ramdisk_id='',reservation_id='r-u8pw8uhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1862271743',owner_user_name='tempest-VolumesSnapshotTestJSON-1862271743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cfc37f67c214e638adb1409d4db18d6',uuid=21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "address": "fa:16:3e:c4:77:ef", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db4c40e-e5", "ovs_interfaceid": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converting VIF {"id": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "address": "fa:16:3e:c4:77:ef", "network": {"id": "a6b0a099-99ae-4b99-8ef5-8e48abbddc4d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1827796540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2edf2107c94e1195d57905b59344fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db4c40e-e5", "ovs_interfaceid": "5db4c40e-e5fe-4aff-82c2-33a2bc44478f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:77:ef,bridge_name='br-int',has_traffic_filtering=True,id=5db4c40e-e5fe-4aff-82c2-33a2bc44478f,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db4c40e-e5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:07:33 user nova-compute[70645]: DEBUG os_vif [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:77:ef,bridge_name='br-int',has_traffic_filtering=True,id=5db4c40e-e5fe-4aff-82c2-33a2bc44478f,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db4c40e-e5') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5db4c40e-e5, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:34 user nova-compute[70645]: INFO os_vif [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:77:ef,bridge_name='br-int',has_traffic_filtering=True,id=5db4c40e-e5fe-4aff-82c2-33a2bc44478f,network=Network(a6b0a099-99ae-4b99-8ef5-8e48abbddc4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db4c40e-e5')
Jul 24 15:07:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSzLlTHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:07:34 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:07:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e81bb590-29e0-4fcb-a154-00487d8dcc54', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[34909a53-f62f-470c-b64f-b3b501b827f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c7b8b8-e3cf-406d-98da-f9a6b40b052a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:34 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:34 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:07:34 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:07:34 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:07:34 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:07:34 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbaa1cc1120>, {}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Disconnecting from: [] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] <== disconnect_volume: return (71ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:07:34 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Deleting instance files /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e_del
Jul 24 15:07:34 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Deletion of /opt/stack/data/nova/instances/21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e_del complete
Jul 24 15:07:34 user nova-compute[70645]: INFO nova.compute.manager [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Took 1.07 seconds to destroy the instance on the hypervisor.
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG nova.network.neutron [None req-85590d7c-d695-47c4-bea8-3c35f3afe1dd tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Updating instance_info_cache with network_info: [{"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-85590d7c-d695-47c4-bea8-3c35f3afe1dd tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Releasing lock "refresh_cache-4f686b79-b22d-4453-ae35-7a1133d7aa86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG nova.objects.instance [None req-85590d7c-d695-47c4-bea8-3c35f3afe1dd tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'flavor' on Instance uuid 4f686b79-b22d-4453-ae35-7a1133d7aa86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-f32dd2f8-abc5-4475-8fc9-16f35b9cea15 req-e9930b06-8d4b-49bf-887e-ab73b3b0dc77 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-unplugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f32dd2f8-abc5-4475-8fc9-16f35b9cea15 req-e9930b06-8d4b-49bf-887e-ab73b3b0dc77 service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f32dd2f8-abc5-4475-8fc9-16f35b9cea15 req-e9930b06-8d4b-49bf-887e-ab73b3b0dc77 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f32dd2f8-abc5-4475-8fc9-16f35b9cea15 req-e9930b06-8d4b-49bf-887e-ab73b3b0dc77 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-f32dd2f8-abc5-4475-8fc9-16f35b9cea15 req-e9930b06-8d4b-49bf-887e-ab73b3b0dc77 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-unplugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:34 user nova-compute[70645]: WARNING nova.compute.manager [req-f32dd2f8-abc5-4475-8fc9-16f35b9cea15 req-e9930b06-8d4b-49bf-887e-ab73b3b0dc77 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received unexpected event network-vif-unplugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:07:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:07:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:07:35 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Instance destroyed successfully.
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:35 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Took 1.31 seconds to deallocate network for instance.
Jul 24 15:07:35 user nova-compute[70645]: WARNING nova.volume.cinder [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Attachment 061f6628-4012-46e3-8875-806604bce298 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 061f6628-4012-46e3-8875-806604bce298. (HTTP 404) (Request-ID: req-87b08787-13c2-4831-9169-997e5ea30073)
Jul 24 15:07:35 user nova-compute[70645]: INFO nova.compute.manager [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Took 0.03 seconds to detach 1 volumes for instance.
Jul 24 15:07:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-91fb60b7-a0eb-4ae3-90a9-b0f88f031ea4 req-5f47d15d-fc29-495f-af22-791ca7fbf8eb service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Received event network-vif-plugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-91fb60b7-a0eb-4ae3-90a9-b0f88f031ea4 req-5f47d15d-fc29-495f-af22-791ca7fbf8eb service nova] Acquiring lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-91fb60b7-a0eb-4ae3-90a9-b0f88f031ea4 req-5f47d15d-fc29-495f-af22-791ca7fbf8eb service nova] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-91fb60b7-a0eb-4ae3-90a9-b0f88f031ea4 req-5f47d15d-fc29-495f-af22-791ca7fbf8eb service nova] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-91fb60b7-a0eb-4ae3-90a9-b0f88f031ea4 req-5f47d15d-fc29-495f-af22-791ca7fbf8eb service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] No waiting events found dispatching network-vif-plugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:35 user nova-compute[70645]: WARNING nova.compute.manager [req-91fb60b7-a0eb-4ae3-90a9-b0f88f031ea4 req-5f47d15d-fc29-495f-af22-791ca7fbf8eb service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Received unexpected event network-vif-plugged-5db4c40e-e5fe-4aff-82c2-33a2bc44478f for instance with vm_state active and task_state deleting.
Jul 24 15:07:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-91fb60b7-a0eb-4ae3-90a9-b0f88f031ea4 req-5f47d15d-fc29-495f-af22-791ca7fbf8eb service nova] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Received event network-vif-deleted-5db4c40e-e5fe-4aff-82c2-33a2bc44478f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Updating instance_info_cache with network_info: [{"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-10b586d2-6bff-4cb5-bde5-b8fdc035ff07" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:07:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.538s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:36 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Deleted allocations for instance 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e
Jul 24 15:07:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9adcd7f2-fc75-49a8-a85c-17f4477fbea3 tempest-VolumesSnapshotTestJSON-1862271743 tempest-VolumesSnapshotTestJSON-1862271743-project-member] Lock "21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.216s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-a1f88923-5378-42b5-a825-67c029cc8f90 req-489100bd-36eb-41f9-a5d5-64af0aef29a3 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a1f88923-5378-42b5-a825-67c029cc8f90 req-489100bd-36eb-41f9-a5d5-64af0aef29a3 service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a1f88923-5378-42b5-a825-67c029cc8f90 req-489100bd-36eb-41f9-a5d5-64af0aef29a3 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a1f88923-5378-42b5-a825-67c029cc8f90 req-489100bd-36eb-41f9-a5d5-64af0aef29a3 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-a1f88923-5378-42b5-a825-67c029cc8f90 req-489100bd-36eb-41f9-a5d5-64af0aef29a3 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:36 user nova-compute[70645]: WARNING nova.compute.manager [req-a1f88923-5378-42b5-a825-67c029cc8f90 req-489100bd-36eb-41f9-a5d5-64af0aef29a3 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received unexpected event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:07:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:37 user nova-compute[70645]: INFO nova.compute.manager [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Shelving
Jul 24 15:07:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-317e2635-deea-4211-b795-cd1e9e689231 req-1947842d-7234-4ed4-aaf5-501948cb5c9b service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-vif-unplugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-317e2635-deea-4211-b795-cd1e9e689231 req-1947842d-7234-4ed4-aaf5-501948cb5c9b service nova] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-317e2635-deea-4211-b795-cd1e9e689231 req-1947842d-7234-4ed4-aaf5-501948cb5c9b service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-317e2635-deea-4211-b795-cd1e9e689231 req-1947842d-7234-4ed4-aaf5-501948cb5c9b service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-317e2635-deea-4211-b795-cd1e9e689231 req-1947842d-7234-4ed4-aaf5-501948cb5c9b service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] No waiting events found dispatching network-vif-unplugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:37 user nova-compute[70645]: WARNING nova.compute.manager [req-317e2635-deea-4211-b795-cd1e9e689231 req-1947842d-7234-4ed4-aaf5-501948cb5c9b service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received unexpected event network-vif-unplugged-65f3b461-6fb6-4333-a140-5935cdbed714 for instance with vm_state active and task_state shelving.
Jul 24 15:07:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:38 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Instance destroyed successfully.
Jul 24 15:07:38 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Beginning cold snapshot process
Jul 24 15:07:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:38 user nova-compute[70645]: WARNING nova.compute.manager [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received unexpected event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:07:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:38 user nova-compute[70645]: WARNING nova.compute.manager [req-c570497a-909c-4f1c-bc00-e3b03bceb0a4 req-d2a82a73-dbd2-4497-adc9-8cf421c61bc8 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received unexpected event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:07:38 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 15:07:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk /opt/stack/data/nova/instances/snapshots/tmpkbrwz7ll/ad96d6fa1a6e4001ba4b9606635cf6e0 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 4f686b79-b22d-4453-ae35-7a1133d7aa86 due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211259.080365, 4f686b79-b22d-4453-ae35-7a1133d7aa86 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:07:39 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] VM Resumed (Lifecycle Event)
Jul 24 15:07:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-85590d7c-d695-47c4-bea8-3c35f3afe1dd tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211259.0908036, 4f686b79-b22d-4453-ae35-7a1133d7aa86 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:07:39 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] VM Started (Lifecycle Event)
Jul 24 15:07:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk /opt/stack/data/nova/instances/snapshots/tmpkbrwz7ll/ad96d6fa1a6e4001ba4b9606635cf6e0" returned: 0 in 0.770s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:07:39 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Snapshot extracted, beginning image upload
Jul 24 15:07:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-e458c370-e82d-4931-9037-44d7e3762d9a req-7de6f858-d65c-4a0b-b6e7-fc73f6f23866 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e458c370-e82d-4931-9037-44d7e3762d9a req-7de6f858-d65c-4a0b-b6e7-fc73f6f23866 service nova] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e458c370-e82d-4931-9037-44d7e3762d9a req-7de6f858-d65c-4a0b-b6e7-fc73f6f23866 service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e458c370-e82d-4931-9037-44d7e3762d9a req-7de6f858-d65c-4a0b-b6e7-fc73f6f23866 service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-e458c370-e82d-4931-9037-44d7e3762d9a req-7de6f858-d65c-4a0b-b6e7-fc73f6f23866 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] No waiting events found dispatching network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:39 user nova-compute[70645]: WARNING nova.compute.manager [req-e458c370-e82d-4931-9037-44d7e3762d9a req-7de6f858-d65c-4a0b-b6e7-fc73f6f23866 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received unexpected event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 for instance with vm_state active and task_state shelving_image_uploading.
Jul 24 15:07:42 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Snapshot image upload complete
Jul 24 15:07:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:42 user nova-compute[70645]: INFO nova.compute.manager [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Shelve offloading
Jul 24 15:07:42 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Instance destroyed successfully.
Jul 24 15:07:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:07:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquired lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:07:42 user nova-compute[70645]: DEBUG nova.network.neutron [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:07:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:42 user nova-compute[70645]: DEBUG nova.network.neutron [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updating instance_info_cache with network_info: [{"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Releasing lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:07:43 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Instance destroyed successfully.
Jul 24 15:07:43 user nova-compute[70645]: DEBUG nova.objects.instance [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'resources' on Instance uuid 50dc20e7-65ef-4743-8707-9ef7da98f947 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330489753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330489753',id=31,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaXAroQ4BdTvsI0tcXXaibpJpjFI70qBUNCYaWNBQ2yL3snJ4LkWJiVjr8FxamHsO0VuKXioe3d0VYrb0hT4AInm7bicj8DShVjS8c3e60SA9BG30+FFh/DCXsUzU+fDA==',key_name='tempest-keypair-1407958414',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-h40p6unj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member',shelved_at='2023-07-24T15:07:42.186807',shelved_host='user',shelved_image_id='41cf19b3-1d42-4ef5-9b47-a69d516afff3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=50dc20e7-65ef-4743-8707-9ef7da98f947,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:07:43 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:07:43 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:07:43 user nova-compute[70645]: DEBUG os_vif [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65f3b461-6f, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG nova.compute.manager [req-10ca9b0b-c51d-4db5-9214-07f6d9b7669f req-9a956986-617a-4998-8cf3-2d344ff674c8 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-changed-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG nova.compute.manager [req-10ca9b0b-c51d-4db5-9214-07f6d9b7669f req-9a956986-617a-4998-8cf3-2d344ff674c8 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Refreshing instance network info cache due to event network-changed-65f3b461-6fb6-4333-a140-5935cdbed714. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-10ca9b0b-c51d-4db5-9214-07f6d9b7669f req-9a956986-617a-4998-8cf3-2d344ff674c8 service nova] Acquiring lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-10ca9b0b-c51d-4db5-9214-07f6d9b7669f req-9a956986-617a-4998-8cf3-2d344ff674c8 service nova] Acquired lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG nova.network.neutron [req-10ca9b0b-c51d-4db5-9214-07f6d9b7669f req-9a956986-617a-4998-8cf3-2d344ff674c8 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Refreshing network info cache for port 65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:07:44 user nova-compute[70645]: INFO os_vif [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f')
Jul 24 15:07:44 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Deleting instance files /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947_del
Jul 24 15:07:44 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Deletion of /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947_del complete
Jul 24 15:07:44 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Deleted allocations for instance 50dc20e7-65ef-4743-8707-9ef7da98f947
Jul 24 15:07:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG nova.objects.instance [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'numa_topology' on Instance uuid 50dc20e7-65ef-4743-8707-9ef7da98f947 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG nova.network.neutron [req-10ca9b0b-c51d-4db5-9214-07f6d9b7669f req-9a956986-617a-4998-8cf3-2d344ff674c8 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updated VIF entry in instance network info cache for port 65f3b461-6fb6-4333-a140-5935cdbed714. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG nova.network.neutron [req-10ca9b0b-c51d-4db5-9214-07f6d9b7669f req-9a956986-617a-4998-8cf3-2d344ff674c8 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updating instance_info_cache with network_info: [{"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap65f3b461-6f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-10ca9b0b-c51d-4db5-9214-07f6d9b7669f req-9a956986-617a-4998-8cf3-2d344ff674c8 service nova] Releasing lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-05b3d597-9c11-47b3-adb6-54b740fbf8fd tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.363s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:48 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211253.9701095, 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:07:48 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] VM Stopped (Lifecycle Event)
Jul 24 15:07:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d4b674a7-ed08-4e8a-bc53-30ef841b2a92 None None] [instance: 21a9b4cf-1ca1-404c-b3e7-d7a84dd3e88e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:53 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211258.3975346, 50dc20e7-65ef-4743-8707-9ef7da98f947 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:07:53 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] VM Stopped (Lifecycle Event)
Jul 24 15:07:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-adc1ed67-327c-4998-a98c-6319c55904d0 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:07:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:59 user nova-compute[70645]: INFO nova.compute.manager [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Terminating instance
Jul 24 15:07:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:59 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Instance destroyed successfully.
Jul 24 15:07:59 user nova-compute[70645]: DEBUG nova.objects.instance [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'resources' on Instance uuid 734abf9a-96dd-40b4-9b68-2d42fa079216 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1841824952',display_name='tempest-AttachVolumeTestJSON-server-1841824952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1841824952',id=22,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMLbkQBMsR4a+hDUBr6a7aRbORe6/on6xHkq0RJlZIGJHHSRDeijoBX284tbAvvwuA6Lxntt8t7PR2NgacxtAM+JNC3dlGGca1WYyP9ZD/+aBRiNcvf5TmXBq0Tu+cQQw==',key_name='tempest-keypair-548846795',keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-x9wujour',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=734abf9a-96dd-40b4-9b68-2d42fa079216,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "address": "fa:16:3e:c7:b9:c5", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634fb15f-19", "ovs_interfaceid": "634fb15f-19aa-462c-931b-dd76f2ce93b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG os_vif [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap634fb15f-19, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:07:59 user nova-compute[70645]: INFO os_vif [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b9:c5,bridge_name='br-int',has_traffic_filtering=True,id=634fb15f-19aa-462c-931b-dd76f2ce93b0,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634fb15f-19')
Jul 24 15:07:59 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Deleting instance files /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216_del
Jul 24 15:07:59 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Deletion of /opt/stack/data/nova/instances/734abf9a-96dd-40b4-9b68-2d42fa079216_del complete
Jul 24 15:07:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-b5c9a6b2-262a-483c-a2df-edd928aa7ab7 req-cd8ca3ca-38ae-4dbe-a3e2-e3a50a644c3e service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b5c9a6b2-262a-483c-a2df-edd928aa7ab7 req-cd8ca3ca-38ae-4dbe-a3e2-e3a50a644c3e service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b5c9a6b2-262a-483c-a2df-edd928aa7ab7 req-cd8ca3ca-38ae-4dbe-a3e2-e3a50a644c3e service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b5c9a6b2-262a-483c-a2df-edd928aa7ab7 req-cd8ca3ca-38ae-4dbe-a3e2-e3a50a644c3e service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-b5c9a6b2-262a-483c-a2df-edd928aa7ab7 req-cd8ca3ca-38ae-4dbe-a3e2-e3a50a644c3e service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-b5c9a6b2-262a-483c-a2df-edd928aa7ab7 req-cd8ca3ca-38ae-4dbe-a3e2-e3a50a644c3e service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-unplugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:07:59 user nova-compute[70645]: INFO nova.compute.manager [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Took 0.66 seconds to destroy the instance on the hypervisor.
Jul 24 15:07:59 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:07:59 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:08:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:00 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:08:00 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Took 0.88 seconds to deallocate network for instance.
Jul 24 15:08:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-98590a33-314d-47f3-b492-5a1a0a530b93 req-2474d20c-0e93-443e-b5ec-238ef2ed0aaa service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-deleted-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:00 user nova-compute[70645]: INFO nova.compute.manager [req-98590a33-314d-47f3-b492-5a1a0a530b93 req-2474d20c-0e93-443e-b5ec-238ef2ed0aaa service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Neutron deleted interface 634fb15f-19aa-462c-931b-dd76f2ce93b0; detaching it from the instance and deleting it from the info cache
Jul 24 15:08:00 user nova-compute[70645]: DEBUG nova.network.neutron [req-98590a33-314d-47f3-b492-5a1a0a530b93 req-2474d20c-0e93-443e-b5ec-238ef2ed0aaa service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:08:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-98590a33-314d-47f3-b492-5a1a0a530b93 req-2474d20c-0e93-443e-b5ec-238ef2ed0aaa service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Detach interface failed, port_id=634fb15f-19aa-462c-931b-dd76f2ce93b0, reason: Instance 734abf9a-96dd-40b4-9b68-2d42fa079216 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:08:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:01 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:08:01 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:08:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:01 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Deleted allocations for instance 734abf9a-96dd-40b4-9b68-2d42fa079216
Jul 24 15:08:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e93f82ab-2128-42fa-a232-aa819cdac8bf tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.194s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-a5f8e4fb-8b3d-4aaa-8482-716100f190f1 req-56f584dd-d90b-4230-b5f1-d6909f6ff25f service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a5f8e4fb-8b3d-4aaa-8482-716100f190f1 req-56f584dd-d90b-4230-b5f1-d6909f6ff25f service nova] Acquiring lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a5f8e4fb-8b3d-4aaa-8482-716100f190f1 req-56f584dd-d90b-4230-b5f1-d6909f6ff25f service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a5f8e4fb-8b3d-4aaa-8482-716100f190f1 req-56f584dd-d90b-4230-b5f1-d6909f6ff25f service nova] Lock "734abf9a-96dd-40b4-9b68-2d42fa079216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-a5f8e4fb-8b3d-4aaa-8482-716100f190f1 req-56f584dd-d90b-4230-b5f1-d6909f6ff25f service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] No waiting events found dispatching network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:08:02 user nova-compute[70645]: WARNING nova.compute.manager [req-a5f8e4fb-8b3d-4aaa-8482-716100f190f1 req-56f584dd-d90b-4230-b5f1-d6909f6ff25f service nova] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Received unexpected event network-vif-plugged-634fb15f-19aa-462c-931b-dd76f2ce93b0 for instance with vm_state deleted and task_state None.
Jul 24 15:08:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:03 user nova-compute[70645]: INFO nova.compute.manager [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Terminating instance
Jul 24 15:08:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:08:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Received event network-vif-unplugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] Lock "8ad33774-2d1b-480d-871d-f422c941c806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] Lock "8ad33774-2d1b-480d-871d-f422c941c806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] No waiting events found dispatching network-vif-unplugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Received event network-vif-unplugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Received event network-vif-plugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] Acquiring lock "8ad33774-2d1b-480d-871d-f422c941c806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] Lock "8ad33774-2d1b-480d-871d-f422c941c806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] Lock "8ad33774-2d1b-480d-871d-f422c941c806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] No waiting events found dispatching network-vif-plugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:08:04 user nova-compute[70645]: WARNING nova.compute.manager [req-080bdf95-4a6b-4213-91af-fbe164d94e52 req-17e37e3a-0306-44a6-a676-5a1336232235 service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Received unexpected event network-vif-plugged-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 for instance with vm_state active and task_state deleting.
Jul 24 15:08:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Instance destroyed successfully.
Jul 24 15:08:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lazy-loading 'resources' on Instance uuid 8ad33774-2d1b-480d-871d-f422c941c806 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1650598652',display_name='tempest-TestServerVolumeAttachmentScenario-server-1650598652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1650598652',id=26,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWgRd3GwZFX0rTua2lxmm6v0b7YJZWOQPOediwnal7za7tlbKkuF39FOtaqxEUgiXHP+l6kQhiIYQr05RCTC5VF+jcqJNJ/J0g+nQDB9u0K0qQcIen0PVcZkMao+M5bqg==',key_name='tempest-keypair-798610159',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08aea075d521479db680d0553e30f0a0',ramdisk_id='',reservation_id='r-fvkbwygu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1433307753',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1433307753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2693e2ea7d864b39b59e96156aa9ca3b',uuid=8ad33774-2d1b-480d-871d-f422c941c806,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "address": "fa:16:3e:e3:de:db", "network": {"id": "c10d23da-ee3b-45ad-b6d7-cbee6fe26734", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2122699067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aea075d521479db680d0553e30f0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65f6c0a-8a", "ovs_interfaceid": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Converting VIF {"id": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "address": "fa:16:3e:e3:de:db", "network": {"id": "c10d23da-ee3b-45ad-b6d7-cbee6fe26734", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2122699067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aea075d521479db680d0553e30f0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65f6c0a-8a", "ovs_interfaceid": "b65f6c0a-8af9-451a-a64b-bfc1f9b4a504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:de:db,bridge_name='br-int',has_traffic_filtering=True,id=b65f6c0a-8af9-451a-a64b-bfc1f9b4a504,network=Network(c10d23da-ee3b-45ad-b6d7-cbee6fe26734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65f6c0a-8a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG os_vif [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:de:db,bridge_name='br-int',has_traffic_filtering=True,id=b65f6c0a-8af9-451a-a64b-bfc1f9b4a504,network=Network(c10d23da-ee3b-45ad-b6d7-cbee6fe26734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65f6c0a-8a') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb65f6c0a-8a, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:08:04 user nova-compute[70645]: INFO os_vif [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:de:db,bridge_name='br-int',has_traffic_filtering=True,id=b65f6c0a-8af9-451a-a64b-bfc1f9b4a504,network=Network(c10d23da-ee3b-45ad-b6d7-cbee6fe26734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65f6c0a-8a')
Jul 24 15:08:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Deleting instance files /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806_del
Jul 24 15:08:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Deletion of /opt/stack/data/nova/instances/8ad33774-2d1b-480d-871d-f422c941c806_del complete
Jul 24 15:08:04 user nova-compute[70645]: INFO nova.compute.manager [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 24 15:08:04 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:08:04 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:08:05 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:08:05 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Took 0.96 seconds to deallocate network for instance.
Jul 24 15:08:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-adf6b6f4-e9f6-44f2-b5c1-92a5a13bedf7 req-4dd50026-2e32-41fd-94b3-71a390a546fc service nova] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Received event network-vif-deleted-b65f6c0a-8af9-451a-a64b-bfc1f9b4a504 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:05 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:08:05 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:08:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:05 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Deleted allocations for instance 8ad33774-2d1b-480d-871d-f422c941c806
Jul 24 15:08:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f3acb02a-3871-4451-b1c1-fd761704e367 tempest-TestServerVolumeAttachmentScenario-1433307753 tempest-TestServerVolumeAttachmentScenario-1433307753-project-member] Lock "8ad33774-2d1b-480d-871d-f422c941c806" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.421s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:14 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211279.8434646, 734abf9a-96dd-40b4-9b68-2d42fa079216 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:08:14 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] VM Stopped (Lifecycle Event)
Jul 24 15:08:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ec711937-5881-4d11-bea9-a80e9eaa7508 None None] [instance: 734abf9a-96dd-40b4-9b68-2d42fa079216] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211284.0548928, 8ad33774-2d1b-480d-871d-f422c941c806 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:08:19 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] VM Stopped (Lifecycle Event)
Jul 24 15:08:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c500c86a-f452-4560-947e-1c6d737f151e None None] [instance: 8ad33774-2d1b-480d-871d-f422c941c806] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-440392db-85ed-42ad-b573-1870d505d63b req-b8dc7652-5979-4156-b3e6-e521d8b109b5 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-changed-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-440392db-85ed-42ad-b573-1870d505d63b req-b8dc7652-5979-4156-b3e6-e521d8b109b5 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Refreshing instance network info cache due to event network-changed-e5c114ae-433c-4886-8a50-0c01256585af. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-440392db-85ed-42ad-b573-1870d505d63b req-b8dc7652-5979-4156-b3e6-e521d8b109b5 service nova] Acquiring lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-440392db-85ed-42ad-b573-1870d505d63b req-b8dc7652-5979-4156-b3e6-e521d8b109b5 service nova] Acquired lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG nova.network.neutron [req-440392db-85ed-42ad-b573-1870d505d63b req-b8dc7652-5979-4156-b3e6-e521d8b109b5 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Refreshing network info cache for port e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'flavor' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:19 user nova-compute[70645]: INFO nova.compute.manager [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Attaching volume 085f325c-c043-4cff-ad29-d93d93be5f80 to /dev/vdb
Jul 24 15:08:19 user nova-compute[70645]: DEBUG os_brick.utils [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[06adfe42-f99a-41d0-b90f-3bd3337889f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9af244a-5f98-478f-9027-33709d1d196f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcc5171-e64b-4108-9e4d-7885355cd7ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a752271a-81dc-4c93-a0d3-e48bc1b5cdf9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG nova.network.neutron [req-440392db-85ed-42ad-b573-1870d505d63b req-b8dc7652-5979-4156-b3e6-e521d8b109b5 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updated VIF entry in instance network info cache for port e5c114ae-433c-4886-8a50-0c01256585af. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG nova.network.neutron [req-440392db-85ed-42ad-b573-1870d505d63b req-b8dc7652-5979-4156-b3e6-e521d8b109b5 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updating instance_info_cache with network_info: [{"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-440392db-85ed-42ad-b573-1870d505d63b req-b8dc7652-5979-4156-b3e6-e521d8b109b5 service nova] Releasing lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:08:19 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:08:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1615ff-8f9b-430b-ad0c-4e48ef02b833]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG os_brick.utils [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:08:19 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updating existing volume attachment record: d66ad6ee-08b0-4960-b2a7-9416e3f8f0b9 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:08:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:22 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:22 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:23 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:24 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:26 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:08:26 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7300MB free_disk=25.191661834716797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Applying migration context for instance 82005166-20b9-4dce-b0fe-812766f1670d as it has an incoming, in-progress migration 6e7cd619-15ed-41e7-8381-10291ad678fe. Migration status is finished {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 15:08:26 user nova-compute[70645]: INFO nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating resource usage from migration 6e7cd619-15ed-41e7-8381-10291ad678fe
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 07adce07-b416-44fb-b548-17b8cd0d8168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 4f686b79-b22d-4453-ae35-7a1133d7aa86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Migration 6e7cd619-15ed-41e7-8381-10291ad678fe is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 82005166-20b9-4dce-b0fe-812766f1670d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b88eed64-1249-4a30-b881-29e5ac81d9a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvfKXdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:08:26 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:08:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:08:26 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:08:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:08:26 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd02b6a-4249-40a6-b425-f3157d6af792]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:08:26 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4e69d3-8c0f-43a2-8adc-5c0005e792bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80] added
Jul 24 15:08:26 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bc75f6-d66e-46d1-b06a-dce60e4482b0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:08:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[992bc2eb-914c-498b-9460-d2b30697b010]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUvfKXdm {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUvfKXdm" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[155a2d53-b725-49d0-a27b-3ceb28d01b4a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUvfKXdm'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcce785-9e59-4086-9616-a7c3242d5090]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b29b88-d341-445b-844f-a893305d3aeb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:08:27 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:08:27 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:08:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:08:27 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:08:27 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:08:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5060d6d7-56d8-4655-af83-3ea67bda9fc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80, portal: 172.16.0.220,3260]
Jul 24 15:08:27 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80, portal: 172.16.0.220,3260] successful.
Jul 24 15:08:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d91cf52-c091-42d6-a7b3-5d4b832e178c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[114271fd-ec34-4027-9ae2-1d6e68f9d0e7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:08:27 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:08:27 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:08:27 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:08:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:08:27 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:08:27 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:08:27 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:08:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aba29e-ea2b-4df5-b42d-004e9a4f5f8e]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:08:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvfKXdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23538613763623132', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538613763623132', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'flavor' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:08:28 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:08:28 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:08:28 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:08:28 user nova-compute[70645]:   <serial>085f325c-c043-4cff-ad29-d93d93be5f80</serial>
Jul 24 15:08:28 user nova-compute[70645]: </disk>
Jul 24 15:08:28 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updating instance_info_cache with network_info: [{"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-20469e51-a240-48ea-bdf4-f7a59d129232" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No VIF found with MAC fa:16:3e:d4:1d:1a, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:08:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9f3fd6bc-7208-4c9b-b26c-f7d7c600e5f8 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.562s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:29 user nova-compute[70645]: INFO nova.compute.manager [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Rescuing
Jul 24 15:08:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:08:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquired lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:08:29 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updating instance_info_cache with network_info: [{"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Releasing lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e3ed190-54c9-4dae-a973-b5e097674031 req-1d5a628b-6998-4680-a234-26716a7bd242 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-unplugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e3ed190-54c9-4dae-a973-b5e097674031 req-1d5a628b-6998-4680-a234-26716a7bd242 service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e3ed190-54c9-4dae-a973-b5e097674031 req-1d5a628b-6998-4680-a234-26716a7bd242 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e3ed190-54c9-4dae-a973-b5e097674031 req-1d5a628b-6998-4680-a234-26716a7bd242 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e3ed190-54c9-4dae-a973-b5e097674031 req-1d5a628b-6998-4680-a234-26716a7bd242 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-unplugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:08:30 user nova-compute[70645]: WARNING nova.compute.manager [req-3e3ed190-54c9-4dae-a973-b5e097674031 req-1d5a628b-6998-4680-a234-26716a7bd242 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received unexpected event network-vif-unplugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with vm_state active and task_state rescuing.
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Instance destroyed successfully.
Jul 24 15:08:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Attempting rescue
Jul 24 15:08:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70645) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Instance directory exists: not creating {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 15:08:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Creating image(s)
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "/opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "/opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'trusted_certs' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.rescue {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.rescue" returned: 0 in 0.053s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'migration_context' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Start _get_guest_xml network_info=[{"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "vif_mac": "fa:16:3e:d4:1d:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'resources' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'numa_topology' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:31 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:08:31 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-682817805',display_name='tempest-ServerRescueNegativeTestJSON-server-682817805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-682817805',id=32,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONsBzgzH8OSaVH0EufkBS4/tqJwCDScyZHEPq7KVN2duIQjhyV4RSbbUo7s/YWEOXmmyUj4zOGsIkLga0IXalBEY4yu30RqKaDrugQXXQjX8kKFWpucjI6SQ0mE6fffJQ==',key_name='tempest-keypair-1103917478',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:06:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-pvr9zonq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "vif_mac": "fa:16:3e:d4:1d:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "vif_mac": "fa:16:3e:d4:1d:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:1d:1a,bridge_name='br-int',has_traffic_filtering=True,id=e5c114ae-433c-4886-8a50-0c01256585af,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c114ae-43') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'pci_devices' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:08:31 user nova-compute[70645]:   <uuid>271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3</uuid>
Jul 24 15:08:31 user nova-compute[70645]:   <name>instance-00000020</name>
Jul 24 15:08:31 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:08:31 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:08:31 user nova-compute[70645]:   <metadata>
Jul 24 15:08:31 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:08:31 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:08:31 user nova-compute[70645]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-682817805</nova:name>
Jul 24 15:08:31 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:08:31</nova:creationTime>
Jul 24 15:08:31 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:08:31 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:08:31 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:08:31 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:08:31 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:08:31 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:08:31 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:08:31 user nova-compute[70645]:       <nova:owner>
Jul 24 15:08:31 user nova-compute[70645]:         <nova:user uuid="74440f1d0cf141fdb6b40b0d1e3a5d13">tempest-ServerRescueNegativeTestJSON-1652524619-project-member</nova:user>
Jul 24 15:08:31 user nova-compute[70645]:         <nova:project uuid="c3f8500e5a144902be74f12f3caf8ae2">tempest-ServerRescueNegativeTestJSON-1652524619</nova:project>
Jul 24 15:08:31 user nova-compute[70645]:       </nova:owner>
Jul 24 15:08:31 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:08:31 user nova-compute[70645]:       <nova:ports>
Jul 24 15:08:31 user nova-compute[70645]:         <nova:port uuid="e5c114ae-433c-4886-8a50-0c01256585af">
Jul 24 15:08:31 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 15:08:31 user nova-compute[70645]:         </nova:port>
Jul 24 15:08:31 user nova-compute[70645]:       </nova:ports>
Jul 24 15:08:31 user nova-compute[70645]:     </nova:instance>
Jul 24 15:08:31 user nova-compute[70645]:   </metadata>
Jul 24 15:08:31 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:08:31 user nova-compute[70645]:     <system>
Jul 24 15:08:31 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:08:31 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:08:31 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:08:31 user nova-compute[70645]:       <entry name="serial">271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3</entry>
Jul 24 15:08:31 user nova-compute[70645]:       <entry name="uuid">271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3</entry>
Jul 24 15:08:31 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:08:31 user nova-compute[70645]:     </system>
Jul 24 15:08:31 user nova-compute[70645]:   </sysinfo>
Jul 24 15:08:31 user nova-compute[70645]:   <os>
Jul 24 15:08:31 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:08:31 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:08:31 user nova-compute[70645]:   </os>
Jul 24 15:08:31 user nova-compute[70645]:   <features>
Jul 24 15:08:31 user nova-compute[70645]:     <acpi/>
Jul 24 15:08:31 user nova-compute[70645]:     <apic/>
Jul 24 15:08:31 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:08:31 user nova-compute[70645]:   </features>
Jul 24 15:08:31 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:08:31 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:08:31 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:08:31 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:08:31 user nova-compute[70645]:   </clock>
Jul 24 15:08:31 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:08:31 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:08:31 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:08:31 user nova-compute[70645]:   </cpu>
Jul 24 15:08:31 user nova-compute[70645]:   <devices>
Jul 24 15:08:31 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:08:31 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:08:31 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.rescue"/>
Jul 24 15:08:31 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:08:31 user nova-compute[70645]:     </disk>
Jul 24 15:08:31 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:08:31 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:08:31 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk"/>
Jul 24 15:08:31 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 15:08:31 user nova-compute[70645]:     </disk>
Jul 24 15:08:31 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:08:31 user nova-compute[70645]:       <mac address="fa:16:3e:d4:1d:1a"/>
Jul 24 15:08:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:08:31 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:08:31 user nova-compute[70645]:       <target dev="tape5c114ae-43"/>
Jul 24 15:08:31 user nova-compute[70645]:     </interface>
Jul 24 15:08:31 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:08:31 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/console.log" append="off"/>
Jul 24 15:08:31 user nova-compute[70645]:     </serial>
Jul 24 15:08:31 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:08:31 user nova-compute[70645]:     <video>
Jul 24 15:08:31 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:08:31 user nova-compute[70645]:     </video>
Jul 24 15:08:31 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:08:31 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:08:31 user nova-compute[70645]:     </rng>
Jul 24 15:08:31 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:08:31 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:08:31 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:08:31 user nova-compute[70645]:     </memballoon>
Jul 24 15:08:31 user nova-compute[70645]:   </devices>
Jul 24 15:08:31 user nova-compute[70645]: </domain>
Jul 24 15:08:31 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:08:31 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Instance destroyed successfully.
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] No VIF found with MAC fa:16:3e:d4:1d:1a, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:08:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-0b1a3da7-28ba-4984-b66d-b21398926395 req-c0cde9f1-2189-4e71-95f4-7c171a6dc232 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0b1a3da7-28ba-4984-b66d-b21398926395 req-c0cde9f1-2189-4e71-95f4-7c171a6dc232 service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0b1a3da7-28ba-4984-b66d-b21398926395 req-c0cde9f1-2189-4e71-95f4-7c171a6dc232 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0b1a3da7-28ba-4984-b66d-b21398926395 req-c0cde9f1-2189-4e71-95f4-7c171a6dc232 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-0b1a3da7-28ba-4984-b66d-b21398926395 req-c0cde9f1-2189-4e71-95f4-7c171a6dc232 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:08:32 user nova-compute[70645]: WARNING nova.compute.manager [req-0b1a3da7-28ba-4984-b66d-b21398926395 req-c0cde9f1-2189-4e71-95f4-7c171a6dc232 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received unexpected event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with vm_state active and task_state rescuing.
Jul 24 15:08:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:08:34 user nova-compute[70645]: WARNING nova.compute.manager [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received unexpected event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with vm_state active and task_state rescuing.
Jul 24 15:08:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:08:34 user nova-compute[70645]: WARNING nova.compute.manager [req-8d28c089-4799-4f2f-a3ac-226400cf24d2 req-ea757a3b-7576-4c02-bd61-cd44b641e515 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received unexpected event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with vm_state active and task_state rescuing.
Jul 24 15:08:34 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] There are 0 instances to clean {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211314.9536881, 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:08:34 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] VM Resumed (Lifecycle Event)
Jul 24 15:08:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2a9afda1-987a-4a4f-8a6c-8bd600f33188 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:08:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:08:35 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 15:08:35 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211314.9552548, 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:08:35 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] VM Started (Lifecycle Event)
Jul 24 15:08:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:08:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:08:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70645) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 15:08:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:08:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:08:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:08:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:08:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:08:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "82005166-20b9-4dce-b0fe-812766f1670d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Going to confirm migration 2 {{(pid=70645) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4693}}
Jul 24 15:08:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:08:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquired lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:08:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:08:52 user nova-compute[70645]: DEBUG nova.objects.instance [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'info_cache' on Instance uuid 82005166-20b9-4dce-b0fe-812766f1670d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating instance_info_cache with network_info: [{"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:08:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Releasing lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:08:52 user nova-compute[70645]: DEBUG nova.objects.instance [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'migration_context' on Instance uuid 82005166-20b9-4dce-b0fe-812766f1670d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:53 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:08:53 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:08:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.497s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:53 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Deleted allocation for migration 6e7cd619-15ed-41e7-8381-10291ad678fe
Jul 24 15:08:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-33f23c83-50c2-40f6-b014-433eda3095d3 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "82005166-20b9-4dce-b0fe-812766f1670d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.671s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:08:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:08:53 user nova-compute[70645]: INFO nova.compute.claims [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Claim successful on node user
Jul 24 15:08:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:08:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:08:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:08:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Creating image(s)
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "/opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "/opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "/opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk 1073741824" returned: 0 in 0.063s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:08:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:08:55 user nova-compute[70645]: DEBUG nova.policy [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa4b836a11a044a583cb21072f0e4922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dacb396f6be4936ac1c4d115bf98d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:08:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:08:55 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Cannot resize image /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:08:55 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'migration_context' on Instance uuid aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:08:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Ensure instance console log exists: /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:08:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Successfully created port: 18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:08:56 user nova-compute[70645]: WARNING nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid b13c0261-b25c-48ce-9245-fa43dadc1829 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid cf8bcde0-6825-45f0-85c3-14188211558c {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 07adce07-b416-44fb-b548-17b8cd0d8168 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 4f686b79-b22d-4453-ae35-7a1133d7aa86 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 82005166-20b9-4dce-b0fe-812766f1670d {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid b88eed64-1249-4a30-b881-29e5ac81d9a3 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "b13c0261-b25c-48ce-9245-fa43dadc1829" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "74c53188-2399-4515-94e6-4ff3e94d7559" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "cf8bcde0-6825-45f0-85c3-14188211558c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "07adce07-b416-44fb-b548-17b8cd0d8168" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "07adce07-b416-44fb-b548-17b8cd0d8168" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "82005166-20b9-4dce-b0fe-812766f1670d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "b88eed64-1249-4a30-b881-29e5ac81d9a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "cf8bcde0-6825-45f0-85c3-14188211558c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "07adce07-b416-44fb-b548-17b8cd0d8168" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "74c53188-2399-4515-94e6-4ff3e94d7559" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "82005166-20b9-4dce-b0fe-812766f1670d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Successfully updated port: 18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "refresh_cache-aad9c89c-c216-4329-8457-c1057ab17ec8" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquired lock "refresh_cache-aad9c89c-c216-4329-8457-c1057ab17ec8" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [req-4d41b118-fed7-4c51-885b-bfacc8b7f577 req-25fefe59-1477-444e-8d2a-6861d14a38dd service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Received event network-changed-18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG nova.compute.manager [req-4d41b118-fed7-4c51-885b-bfacc8b7f577 req-25fefe59-1477-444e-8d2a-6861d14a38dd service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Refreshing instance network info cache due to event network-changed-18ca2b69-127c-416b-8604-118d00ceac1f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:08:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4d41b118-fed7-4c51-885b-bfacc8b7f577 req-25fefe59-1477-444e-8d2a-6861d14a38dd service nova] Acquiring lock "refresh_cache-aad9c89c-c216-4329-8457-c1057ab17ec8" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Updating instance_info_cache with network_info: [{"id": "18ca2b69-127c-416b-8604-118d00ceac1f", "address": "fa:16:3e:8a:b5:9c", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ca2b69-12", "ovs_interfaceid": "18ca2b69-127c-416b-8604-118d00ceac1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Releasing lock "refresh_cache-aad9c89c-c216-4329-8457-c1057ab17ec8" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Instance network_info: |[{"id": "18ca2b69-127c-416b-8604-118d00ceac1f", "address": "fa:16:3e:8a:b5:9c", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ca2b69-12", "ovs_interfaceid": "18ca2b69-127c-416b-8604-118d00ceac1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4d41b118-fed7-4c51-885b-bfacc8b7f577 req-25fefe59-1477-444e-8d2a-6861d14a38dd service nova] Acquired lock "refresh_cache-aad9c89c-c216-4329-8457-c1057ab17ec8" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.network.neutron [req-4d41b118-fed7-4c51-885b-bfacc8b7f577 req-25fefe59-1477-444e-8d2a-6861d14a38dd service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Refreshing network info cache for port 18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Start _get_guest_xml network_info=[{"id": "18ca2b69-127c-416b-8604-118d00ceac1f", "address": "fa:16:3e:8a:b5:9c", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ca2b69-12", "ovs_interfaceid": "18ca2b69-127c-416b-8604-118d00ceac1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:08:57 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:08:57 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1564163967',display_name='tempest-AttachVolumeTestJSON-server-1564163967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1564163967',id=34,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7YyolXS6pGWfpcHWTeJ2vAYnAuiwOCCoKbADmomA5RC73gpCDcgFczFmQ54R1l+CFPner+J0PLtA9ldRVQNA/JMLZbunpS5dlUTX//b0P+g+6yBFXuMoVnRNdxrDDhgA==',key_name='tempest-keypair-1406990156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-cft27uws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=aad9c89c-c216-4329-8457-c1057ab17ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18ca2b69-127c-416b-8604-118d00ceac1f", "address": "fa:16:3e:8a:b5:9c", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ca2b69-12", "ovs_interfaceid": "18ca2b69-127c-416b-8604-118d00ceac1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "18ca2b69-127c-416b-8604-118d00ceac1f", "address": "fa:16:3e:8a:b5:9c", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ca2b69-12", "ovs_interfaceid": "18ca2b69-127c-416b-8604-118d00ceac1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=18ca2b69-127c-416b-8604-118d00ceac1f,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ca2b69-12') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'pci_devices' on Instance uuid aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:08:57 user nova-compute[70645]:   <uuid>aad9c89c-c216-4329-8457-c1057ab17ec8</uuid>
Jul 24 15:08:57 user nova-compute[70645]:   <name>instance-00000022</name>
Jul 24 15:08:57 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:08:57 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:08:57 user nova-compute[70645]:   <metadata>
Jul 24 15:08:57 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:08:57 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:08:57 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeTestJSON-server-1564163967</nova:name>
Jul 24 15:08:57 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:08:57</nova:creationTime>
Jul 24 15:08:57 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:08:57 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:08:57 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:08:57 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:08:57 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:08:57 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:08:57 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:08:57 user nova-compute[70645]:       <nova:owner>
Jul 24 15:08:57 user nova-compute[70645]:         <nova:user uuid="fa4b836a11a044a583cb21072f0e4922">tempest-AttachVolumeTestJSON-1397935195-project-member</nova:user>
Jul 24 15:08:57 user nova-compute[70645]:         <nova:project uuid="2dacb396f6be4936ac1c4d115bf98d6a">tempest-AttachVolumeTestJSON-1397935195</nova:project>
Jul 24 15:08:57 user nova-compute[70645]:       </nova:owner>
Jul 24 15:08:57 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:08:57 user nova-compute[70645]:       <nova:ports>
Jul 24 15:08:57 user nova-compute[70645]:         <nova:port uuid="18ca2b69-127c-416b-8604-118d00ceac1f">
Jul 24 15:08:57 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 15:08:57 user nova-compute[70645]:         </nova:port>
Jul 24 15:08:57 user nova-compute[70645]:       </nova:ports>
Jul 24 15:08:57 user nova-compute[70645]:     </nova:instance>
Jul 24 15:08:57 user nova-compute[70645]:   </metadata>
Jul 24 15:08:57 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:08:57 user nova-compute[70645]:     <system>
Jul 24 15:08:57 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:08:57 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:08:57 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:08:57 user nova-compute[70645]:       <entry name="serial">aad9c89c-c216-4329-8457-c1057ab17ec8</entry>
Jul 24 15:08:57 user nova-compute[70645]:       <entry name="uuid">aad9c89c-c216-4329-8457-c1057ab17ec8</entry>
Jul 24 15:08:57 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:08:57 user nova-compute[70645]:     </system>
Jul 24 15:08:57 user nova-compute[70645]:   </sysinfo>
Jul 24 15:08:57 user nova-compute[70645]:   <os>
Jul 24 15:08:57 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:08:57 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:08:57 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:08:57 user nova-compute[70645]:   </os>
Jul 24 15:08:57 user nova-compute[70645]:   <features>
Jul 24 15:08:57 user nova-compute[70645]:     <acpi/>
Jul 24 15:08:57 user nova-compute[70645]:     <apic/>
Jul 24 15:08:57 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:08:57 user nova-compute[70645]:   </features>
Jul 24 15:08:57 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:08:57 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:08:57 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:08:57 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:08:57 user nova-compute[70645]:   </clock>
Jul 24 15:08:57 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:08:57 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:08:57 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:08:57 user nova-compute[70645]:   </cpu>
Jul 24 15:08:57 user nova-compute[70645]:   <devices>
Jul 24 15:08:57 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:08:57 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:08:57 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk"/>
Jul 24 15:08:57 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:08:57 user nova-compute[70645]:     </disk>
Jul 24 15:08:57 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:08:57 user nova-compute[70645]:       <mac address="fa:16:3e:8a:b5:9c"/>
Jul 24 15:08:57 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:08:57 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:08:57 user nova-compute[70645]:       <target dev="tap18ca2b69-12"/>
Jul 24 15:08:57 user nova-compute[70645]:     </interface>
Jul 24 15:08:57 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:08:57 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/console.log" append="off"/>
Jul 24 15:08:57 user nova-compute[70645]:     </serial>
Jul 24 15:08:57 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:08:57 user nova-compute[70645]:     <video>
Jul 24 15:08:57 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:08:57 user nova-compute[70645]:     </video>
Jul 24 15:08:57 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:08:57 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:08:57 user nova-compute[70645]:     </rng>
Jul 24 15:08:57 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:08:57 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:08:57 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:08:57 user nova-compute[70645]:     </memballoon>
Jul 24 15:08:57 user nova-compute[70645]:   </devices>
Jul 24 15:08:57 user nova-compute[70645]: </domain>
Jul 24 15:08:57 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1564163967',display_name='tempest-AttachVolumeTestJSON-server-1564163967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1564163967',id=34,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7YyolXS6pGWfpcHWTeJ2vAYnAuiwOCCoKbADmomA5RC73gpCDcgFczFmQ54R1l+CFPner+J0PLtA9ldRVQNA/JMLZbunpS5dlUTX//b0P+g+6yBFXuMoVnRNdxrDDhgA==',key_name='tempest-keypair-1406990156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-cft27uws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=aad9c89c-c216-4329-8457-c1057ab17ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18ca2b69-127c-416b-8604-118d00ceac1f", "address": "fa:16:3e:8a:b5:9c", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ca2b69-12", "ovs_interfaceid": "18ca2b69-127c-416b-8604-118d00ceac1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "18ca2b69-127c-416b-8604-118d00ceac1f", "address": "fa:16:3e:8a:b5:9c", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ca2b69-12", "ovs_interfaceid": "18ca2b69-127c-416b-8604-118d00ceac1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=18ca2b69-127c-416b-8604-118d00ceac1f,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ca2b69-12') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG os_vif [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=18ca2b69-127c-416b-8604-118d00ceac1f,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ca2b69-12') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18ca2b69-12, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18ca2b69-12, col_values=(('external_ids', {'iface-id': '18ca2b69-127c-416b-8604-118d00ceac1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:b5:9c', 'vm-uuid': 'aad9c89c-c216-4329-8457-c1057ab17ec8'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:57 user nova-compute[70645]: INFO os_vif [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=18ca2b69-127c-416b-8604-118d00ceac1f,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ca2b69-12')
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No VIF found with MAC fa:16:3e:8a:b5:9c, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.network.neutron [req-4d41b118-fed7-4c51-885b-bfacc8b7f577 req-25fefe59-1477-444e-8d2a-6861d14a38dd service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Updated VIF entry in instance network info cache for port 18ca2b69-127c-416b-8604-118d00ceac1f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:08:57 user nova-compute[70645]: DEBUG nova.network.neutron [req-4d41b118-fed7-4c51-885b-bfacc8b7f577 req-25fefe59-1477-444e-8d2a-6861d14a38dd service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Updating instance_info_cache with network_info: [{"id": "18ca2b69-127c-416b-8604-118d00ceac1f", "address": "fa:16:3e:8a:b5:9c", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ca2b69-12", "ovs_interfaceid": "18ca2b69-127c-416b-8604-118d00ceac1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:08:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4d41b118-fed7-4c51-885b-bfacc8b7f577 req-25fefe59-1477-444e-8d2a-6861d14a38dd service nova] Releasing lock "refresh_cache-aad9c89c-c216-4329-8457-c1057ab17ec8" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:08:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-d676754a-07b5-4f2f-b6bf-3d9ce07894cc req-fbbf2bc5-2a2f-4235-a2af-915bb860003e service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Received event network-vif-plugged-18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:08:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d676754a-07b5-4f2f-b6bf-3d9ce07894cc req-fbbf2bc5-2a2f-4235-a2af-915bb860003e service nova] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:08:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d676754a-07b5-4f2f-b6bf-3d9ce07894cc req-fbbf2bc5-2a2f-4235-a2af-915bb860003e service nova] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:08:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d676754a-07b5-4f2f-b6bf-3d9ce07894cc req-fbbf2bc5-2a2f-4235-a2af-915bb860003e service nova] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:08:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-d676754a-07b5-4f2f-b6bf-3d9ce07894cc req-fbbf2bc5-2a2f-4235-a2af-915bb860003e service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] No waiting events found dispatching network-vif-plugged-18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:08:59 user nova-compute[70645]: WARNING nova.compute.manager [req-d676754a-07b5-4f2f-b6bf-3d9ce07894cc req-fbbf2bc5-2a2f-4235-a2af-915bb860003e service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Received unexpected event network-vif-plugged-18ca2b69-127c-416b-8604-118d00ceac1f for instance with vm_state building and task_state spawning.
Jul 24 15:08:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:08:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211341.1178675, aad9c89c-c216-4329-8457-c1057ab17ec8 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:09:01 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] VM Resumed (Lifecycle Event)
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:09:01 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Instance spawned successfully.
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:01 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211341.1216068, aad9c89c-c216-4329-8457-c1057ab17ec8 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:09:01 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] VM Started (Lifecycle Event)
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:09:01 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-97e700e6-c281-42c6-b6bc-8d6c9bea1194 req-4c0869d6-8802-4589-863e-7e2893c7ab66 service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Received event network-vif-plugged-18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-97e700e6-c281-42c6-b6bc-8d6c9bea1194 req-4c0869d6-8802-4589-863e-7e2893c7ab66 service nova] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-97e700e6-c281-42c6-b6bc-8d6c9bea1194 req-4c0869d6-8802-4589-863e-7e2893c7ab66 service nova] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-97e700e6-c281-42c6-b6bc-8d6c9bea1194 req-4c0869d6-8802-4589-863e-7e2893c7ab66 service nova] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-97e700e6-c281-42c6-b6bc-8d6c9bea1194 req-4c0869d6-8802-4589-863e-7e2893c7ab66 service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] No waiting events found dispatching network-vif-plugged-18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:09:01 user nova-compute[70645]: WARNING nova.compute.manager [req-97e700e6-c281-42c6-b6bc-8d6c9bea1194 req-4c0869d6-8802-4589-863e-7e2893c7ab66 service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Received unexpected event network-vif-plugged-18ca2b69-127c-416b-8604-118d00ceac1f for instance with vm_state building and task_state spawning.
Jul 24 15:09:01 user nova-compute[70645]: INFO nova.compute.manager [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Took 6.80 seconds to spawn the instance on the hypervisor.
Jul 24 15:09:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:09:01 user nova-compute[70645]: INFO nova.compute.manager [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Took 7.76 seconds to build instance.
Jul 24 15:09:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2be50f42-1b55-4adf-8b1d-bccca777e70e tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.887s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.158s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:01 user nova-compute[70645]: INFO nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:09:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "b88eed64-1249-4a30-b881-29e5ac81d9a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:11 user nova-compute[70645]: INFO nova.compute.manager [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Terminating instance
Jul 24 15:09:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-3cd420a2-7a6a-4e4a-ad11-53405f17e945 req-e90bdf78-700b-43b3-aea2-feaea36e2175 service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Received event network-vif-unplugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3cd420a2-7a6a-4e4a-ad11-53405f17e945 req-e90bdf78-700b-43b3-aea2-feaea36e2175 service nova] Acquiring lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3cd420a2-7a6a-4e4a-ad11-53405f17e945 req-e90bdf78-700b-43b3-aea2-feaea36e2175 service nova] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3cd420a2-7a6a-4e4a-ad11-53405f17e945 req-e90bdf78-700b-43b3-aea2-feaea36e2175 service nova] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-3cd420a2-7a6a-4e4a-ad11-53405f17e945 req-e90bdf78-700b-43b3-aea2-feaea36e2175 service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] No waiting events found dispatching network-vif-unplugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-3cd420a2-7a6a-4e4a-ad11-53405f17e945 req-e90bdf78-700b-43b3-aea2-feaea36e2175 service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Received event network-vif-unplugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:09:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Instance destroyed successfully.
Jul 24 15:09:12 user nova-compute[70645]: DEBUG nova.objects.instance [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lazy-loading 'resources' on Instance uuid b88eed64-1249-4a30-b881-29e5ac81d9a3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1335537879',display_name='tempest-ServersNegativeTestJSON-server-1335537879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1335537879',id=33,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3f2a4081bd346928d0e316e7e856479',ramdisk_id='',reservation_id='r-cd6otexj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-118608074',owner_user_name='tempest-ServersNegativeTestJSON-118608074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:07:31Z,user_data=None,user_id='7baae1cced074129abc9c7e46a69001e',uuid=b88eed64-1249-4a30-b881-29e5ac81d9a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "address": "fa:16:3e:00:e6:c9", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f7703a-68", "ovs_interfaceid": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converting VIF {"id": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "address": "fa:16:3e:00:e6:c9", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f7703a-68", "ovs_interfaceid": "14f7703a-68ce-44b2-b928-3b5ae34855e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:e6:c9,bridge_name='br-int',has_traffic_filtering=True,id=14f7703a-68ce-44b2-b928-3b5ae34855e1,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f7703a-68') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG os_vif [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:e6:c9,bridge_name='br-int',has_traffic_filtering=True,id=14f7703a-68ce-44b2-b928-3b5ae34855e1,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f7703a-68') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14f7703a-68, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:12 user nova-compute[70645]: INFO os_vif [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:e6:c9,bridge_name='br-int',has_traffic_filtering=True,id=14f7703a-68ce-44b2-b928-3b5ae34855e1,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f7703a-68')
Jul 24 15:09:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Deleting instance files /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3_del
Jul 24 15:09:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Deletion of /opt/stack/data/nova/instances/b88eed64-1249-4a30-b881-29e5ac81d9a3_del complete
Jul 24 15:09:12 user nova-compute[70645]: INFO nova.compute.manager [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Took 0.79 seconds to destroy the instance on the hypervisor.
Jul 24 15:09:12 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:09:12 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:09:13 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:09:13 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Took 1.00 seconds to deallocate network for instance.
Jul 24 15:09:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:14 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:09:14 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:09:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-69430727-b521-4a45-a366-47e4ab88503a req-704f7173-a775-4df5-ac9e-7f26d7dd1a5e service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Received event network-vif-plugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-69430727-b521-4a45-a366-47e4ab88503a req-704f7173-a775-4df5-ac9e-7f26d7dd1a5e service nova] Acquiring lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-69430727-b521-4a45-a366-47e4ab88503a req-704f7173-a775-4df5-ac9e-7f26d7dd1a5e service nova] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-69430727-b521-4a45-a366-47e4ab88503a req-704f7173-a775-4df5-ac9e-7f26d7dd1a5e service nova] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-69430727-b521-4a45-a366-47e4ab88503a req-704f7173-a775-4df5-ac9e-7f26d7dd1a5e service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] No waiting events found dispatching network-vif-plugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:09:14 user nova-compute[70645]: WARNING nova.compute.manager [req-69430727-b521-4a45-a366-47e4ab88503a req-704f7173-a775-4df5-ac9e-7f26d7dd1a5e service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Received unexpected event network-vif-plugged-14f7703a-68ce-44b2-b928-3b5ae34855e1 for instance with vm_state deleted and task_state None.
Jul 24 15:09:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-69430727-b521-4a45-a366-47e4ab88503a req-704f7173-a775-4df5-ac9e-7f26d7dd1a5e service nova] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Received event network-vif-deleted-14f7703a-68ce-44b2-b928-3b5ae34855e1 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.947s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:14 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Deleted allocations for instance b88eed64-1249-4a30-b881-29e5ac81d9a3
Jul 24 15:09:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-19f4b996-d38e-48b4-89aa-bad828cfcba0 tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "b88eed64-1249-4a30-b881-29e5ac81d9a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.072s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:24 user nova-compute[70645]: INFO nova.compute.manager [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Terminating instance
Jul 24 15:09:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:24 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-e21e4b57-6c80-4ef2-bd11-b7d944e680aa req-08701946-3cd7-43e3-8a9e-ef1c46376ae0 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-unplugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e21e4b57-6c80-4ef2-bd11-b7d944e680aa req-08701946-3cd7-43e3-8a9e-ef1c46376ae0 service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e21e4b57-6c80-4ef2-bd11-b7d944e680aa req-08701946-3cd7-43e3-8a9e-ef1c46376ae0 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e21e4b57-6c80-4ef2-bd11-b7d944e680aa req-08701946-3cd7-43e3-8a9e-ef1c46376ae0 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-e21e4b57-6c80-4ef2-bd11-b7d944e680aa req-08701946-3cd7-43e3-8a9e-ef1c46376ae0 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-unplugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-e21e4b57-6c80-4ef2-bd11-b7d944e680aa req-08701946-3cd7-43e3-8a9e-ef1c46376ae0 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-unplugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:25 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Instance destroyed successfully.
Jul 24 15:09:25 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'resources' on Instance uuid 4f686b79-b22d-4453-ae35-7a1133d7aa86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1406665233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1406665233',id=27,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-ttaam4dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:07:39Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=4f686b79-b22d-4453-ae35-7a1133d7aa86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "fb210eeb-c5aa-4c30-988b-772930ecc039", "address": "fa:16:3e:63:a1:8d", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb210eeb-c5", "ovs_interfaceid": "fb210eeb-c5aa-4c30-988b-772930ecc039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:a1:8d,bridge_name='br-int',has_traffic_filtering=True,id=fb210eeb-c5aa-4c30-988b-772930ecc039,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb210eeb-c5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_vif [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:a1:8d,bridge_name='br-int',has_traffic_filtering=True,id=fb210eeb-c5aa-4c30-988b-772930ecc039,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb210eeb-c5') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb210eeb-c5, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:09:25 user nova-compute[70645]: INFO os_vif [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:a1:8d,bridge_name='br-int',has_traffic_filtering=True,id=fb210eeb-c5aa-4c30-988b-772930ecc039,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb210eeb-c5')
Jul 24 15:09:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmqZWKIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:09:25 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f3bba4-6f56-4df4-9f24-d2dba406eefe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[35063029-f76b-41ca-b4a8-00dd29fa0930]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:09:25 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:09:25 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:09:25 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:09:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:09:25 user nova-compute[70645]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 (non-flash)
Jul 24 15:09:25 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:09:25 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:09:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba841a6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37'): ({'sdd'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Removing single pathed devices sdd {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5420df2e-e87c-4599-8b23-44418df96b7a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de279c0-29fe-408e-a926-44ca7f97b4d8]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flushing IO for device /dev/sdd {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4429b227-c328-4ce7-a421-376988c48130]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8067b1-9528-436f-8e78-b9c6407565b2]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2b35735e-73b0d37f7521184f', '/dev/disk/by-id/scsi-23733623064333766', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2b35735e') {{(pid=81509) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4fc27f-c03d-407d-b032-4ac118611dd5]: (4, None) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacb3af5-61bf-4b48-ba0f-b6d9254e5e00]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[edec94b9-d916-4aff-9c0f-9d675eac0399]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37, portal: 172.16.0.220,3260]
Jul 24 15:09:25 user nova-compute[70645]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37, portal: 172.16.0.220,3260] successful.
Jul 24 15:09:25 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ff20c5-6dd6-430e-9a18-81c906547b37 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[911220f3-a15f-486a-90ee-c12ed64cc735]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] <== disconnect_volume: return (382ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:09:25 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Deleting instance files /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86_del
Jul 24 15:09:25 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Deletion of /opt/stack/data/nova/instances/4f686b79-b22d-4453-ae35-7a1133d7aa86_del complete
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:26 user nova-compute[70645]: INFO nova.compute.manager [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Took 1.28 seconds to destroy the instance on the hypervisor.
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:09:26 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Took 0.67 seconds to deallocate network for instance.
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e03c298-217d-43a6-9629-0ef3dbc4980e req-6dd40a6d-8601-4871-82f3-1abb9f7e7102 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e03c298-217d-43a6-9629-0ef3dbc4980e req-6dd40a6d-8601-4871-82f3-1abb9f7e7102 service nova] Acquiring lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e03c298-217d-43a6-9629-0ef3dbc4980e req-6dd40a6d-8601-4871-82f3-1abb9f7e7102 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e03c298-217d-43a6-9629-0ef3dbc4980e req-6dd40a6d-8601-4871-82f3-1abb9f7e7102 service nova] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e03c298-217d-43a6-9629-0ef3dbc4980e req-6dd40a6d-8601-4871-82f3-1abb9f7e7102 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] No waiting events found dispatching network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:09:27 user nova-compute[70645]: WARNING nova.compute.manager [req-3e03c298-217d-43a6-9629-0ef3dbc4980e req-6dd40a6d-8601-4871-82f3-1abb9f7e7102 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received unexpected event network-vif-plugged-fb210eeb-c5aa-4c30-988b-772930ecc039 for instance with vm_state active and task_state deleting.
Jul 24 15:09:27 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e03c298-217d-43a6-9629-0ef3dbc4980e req-6dd40a6d-8601-4871-82f3-1abb9f7e7102 service nova] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Received event network-vif-deleted-fb210eeb-c5aa-4c30-988b-772930ecc039 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:27 user nova-compute[70645]: INFO nova.compute.manager [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Took 0.82 seconds to detach 1 volumes for instance.
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211352.6267085, b88eed64-1249-4a30-b881-29e5ac81d9a3 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:09:27 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] VM Stopped (Lifecycle Event)
Jul 24 15:09:27 user nova-compute[70645]: DEBUG nova.compute.manager [None req-5e6519c4-a172-44d3-be15-83ff9cf7efb7 None None] [instance: b88eed64-1249-4a30-b881-29e5ac81d9a3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Refreshing inventories for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Updating ProviderTree inventory for provider a0cf5b80-69d2-4191-894e-a498eab7d688 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Refreshing aggregate associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, aggregates: None {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Refreshing trait associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:28 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:09:28 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:09:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.757s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:28 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Deleted allocations for instance 4f686b79-b22d-4453-ae35-7a1133d7aa86
Jul 24 15:09:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7d914817-1818-4f4d-a7dc-cec2bb406113 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "4f686b79-b22d-4453-ae35-7a1133d7aa86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.768s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:09:29 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:09:29 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7552MB free_disk=25.184669494628906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 07adce07-b416-44fb-b548-17b8cd0d8168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 82005166-20b9-4dce-b0fe-812766f1670d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance aad9c89c-c216-4329-8457-c1057ab17ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:09:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.825s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:30 user nova-compute[70645]: INFO nova.compute.manager [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Unshelving
Jul 24 15:09:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:30 user nova-compute[70645]: DEBUG nova.objects.instance [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'pci_requests' on Instance uuid 50dc20e7-65ef-4743-8707-9ef7da98f947 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:09:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:30 user nova-compute[70645]: DEBUG nova.objects.instance [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'numa_topology' on Instance uuid 50dc20e7-65ef-4743-8707-9ef7da98f947 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:09:30 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:09:30 user nova-compute[70645]: INFO nova.compute.claims [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Claim successful on node user
Jul 24 15:09:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:09:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:31 user nova-compute[70645]: INFO nova.network.neutron [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updating port 65f3b461-6fb6-4333-a140-5935cdbed714 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Updating instance_info_cache with network_info: [{"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:09:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquired lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-5701a095-8d50-43fa-9e47-54b584f15596 req-a1b02d08-505e-4742-8093-4a11762008bb service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-changed-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-5701a095-8d50-43fa-9e47-54b584f15596 req-a1b02d08-505e-4742-8093-4a11762008bb service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Refreshing instance network info cache due to event network-changed-65f3b461-6fb6-4333-a140-5935cdbed714. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5701a095-8d50-43fa-9e47-54b584f15596 req-a1b02d08-505e-4742-8093-4a11762008bb service nova] Acquiring lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updating instance_info_cache with network_info: [{"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Releasing lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:09:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Creating image(s)
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "/opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "/opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "/opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'trusted_certs' on Instance uuid 50dc20e7-65ef-4743-8707-9ef7da98f947 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5701a095-8d50-43fa-9e47-54b584f15596 req-a1b02d08-505e-4742-8093-4a11762008bb service nova] Acquired lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG nova.network.neutron [req-5701a095-8d50-43fa-9e47-54b584f15596 req-a1b02d08-505e-4742-8093-4a11762008bb service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Refreshing network info cache for port 65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:09:32 user nova-compute[70645]: INFO nova.compute.claims [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Claim successful on node user
Jul 24 15:09:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775.part --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:33 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:09:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775.part --force-share --output=json" returned: 0 in 0.166s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:33 user nova-compute[70645]: DEBUG nova.virt.images [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] 41cf19b3-1d42-4ef5-9b47-a69d516afff3 was qcow2, converting to raw {{(pid=70645) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 15:09:33 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 15:09:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775.part /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775.converted {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-5701a095-8d50-43fa-9e47-54b584f15596 req-a1b02d08-505e-4742-8093-4a11762008bb service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updated VIF entry in instance network info cache for port 65f3b461-6fb6-4333-a140-5935cdbed714. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-5701a095-8d50-43fa-9e47-54b584f15596 req-a1b02d08-505e-4742-8093-4a11762008bb service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updating instance_info_cache with network_info: [{"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5701a095-8d50-43fa-9e47-54b584f15596 req-a1b02d08-505e-4742-8093-4a11762008bb service nova] Releasing lock "refresh_cache-50dc20e7-65ef-4743-8707-9ef7da98f947" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.577s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775.part /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775.converted" returned: 0 in 0.572s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775.converted --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:09:34 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:09:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.905s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775 --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG nova.policy [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a73120d16244c85b13ec468bca3c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2680ac44b8394d5c8e1b086884cb61f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:09:34 user nova-compute[70645]: INFO nova.virt.block_device [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Booting with volume d287b2a0-2700-4b84-8cc5-4ba3e83faffe at /dev/vda
Jul 24 15:09:34 user nova-compute[70645]: DEBUG os_brick.utils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b341ff-a422-4e25-8f0a-f6bf42ca95b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775 --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775 --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[06933449-4e40-4be8-9222-49a31628400f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[767b57d5-ce94-442e-8d0d-1901c815cde9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2289b74-fea4-4443-a025-dd0997dcc2e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:09:34 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1238fe8f-18ec-41ab-baef-9b264eb4eaa8]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG os_brick.utils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating existing volume attachment record: 5a1f8855-b993-4abe-bb4a-ea7faf3922ec {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775 --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775,backing_fmt=raw /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775,backing_fmt=raw /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk 1073741824" returned: 0 in 0.066s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775 --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775 --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:35 user nova-compute[70645]: DEBUG nova.objects.instance [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'migration_context' on Instance uuid 50dc20e7-65ef-4743-8707-9ef7da98f947 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:09:35 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Rebasing disk image.
Jul 24 15:09:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b -F raw /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:35 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Successfully created port: 33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:09:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:36 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Successfully updated port: 33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:09:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:09:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquired lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:09:36 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:09:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-67030fb9-0c86-413c-a6b5-083ce3a09480 req-1c566954-c5b0-4b4d-b063-966e763d0d82 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-changed-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-67030fb9-0c86-413c-a6b5-083ce3a09480 req-1c566954-c5b0-4b4d-b063-966e763d0d82 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Refreshing instance network info cache due to event network-changed-33997fc3-0a55-4ace-8e42-d1d57ae5f66f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:09:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-67030fb9-0c86-413c-a6b5-083ce3a09480 req-1c566954-c5b0-4b4d-b063-966e763d0d82 service nova] Acquiring lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:09:36 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:09:36 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating instance_info_cache with network_info: [{"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Releasing lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Instance network_info: |[{"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-67030fb9-0c86-413c-a6b5-083ce3a09480 req-1c566954-c5b0-4b4d-b063-966e763d0d82 service nova] Acquired lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-67030fb9-0c86-413c-a6b5-083ce3a09480 req-1c566954-c5b0-4b4d-b063-966e763d0d82 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Refreshing network info cache for port 33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-67030fb9-0c86-413c-a6b5-083ce3a09480 req-1c566954-c5b0-4b4d-b063-966e763d0d82 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updated VIF entry in instance network info cache for port 33997fc3-0a55-4ace-8e42-d1d57ae5f66f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-67030fb9-0c86-413c-a6b5-083ce3a09480 req-1c566954-c5b0-4b4d-b063-966e763d0d82 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating instance_info_cache with network_info: [{"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-67030fb9-0c86-413c-a6b5-083ce3a09480 req-1c566954-c5b0-4b4d-b063-966e763d0d82 service nova] Releasing lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b -F raw /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk" returned: 0 in 2.487s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Ensure instance console log exists: /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Start _get_guest_xml network_info=[{"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3fcdb523e6c7f9929917baf99ba27707',container_format='bare',created_at=2023-07-24T15:07:37Z,direct_url=<?>,disk_format='qcow2',id=41cf19b3-1d42-4ef5-9b47-a69d516afff3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1330489753-shelved',owner='5d01222b2028429fae08bb542e5cd9cc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-24T15:07:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:09:37 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:09:37 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3fcdb523e6c7f9929917baf99ba27707',container_format='bare',created_at=2023-07-24T15:07:37Z,direct_url=<?>,disk_format='qcow2',id=41cf19b3-1d42-4ef5-9b47-a69d516afff3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1330489753-shelved',owner='5d01222b2028429fae08bb542e5cd9cc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-24T15:07:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.objects.instance [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'vcpu_model' on Instance uuid 50dc20e7-65ef-4743-8707-9ef7da98f947 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T15:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330489753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330489753',id=31,image_ref='41cf19b3-1d42-4ef5-9b47-a69d516afff3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1407958414',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-h40p6unj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member',shelved_at='2023-07-24T15:07:42.186807',shelved_host='user',shelved_image_id='41cf19b3-1d42-4ef5-9b47-a69d516afff3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:09:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=50dc20e7-65ef-4743-8707-9ef7da98f947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.objects.instance [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'pci_devices' on Instance uuid 50dc20e7-65ef-4743-8707-9ef7da98f947 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:09:37 user nova-compute[70645]:   <uuid>50dc20e7-65ef-4743-8707-9ef7da98f947</uuid>
Jul 24 15:09:37 user nova-compute[70645]:   <name>instance-0000001f</name>
Jul 24 15:09:37 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:09:37 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:09:37 user nova-compute[70645]:   <metadata>
Jul 24 15:09:37 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:09:37 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:09:37 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1330489753</nova:name>
Jul 24 15:09:37 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:09:37</nova:creationTime>
Jul 24 15:09:37 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:09:37 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:09:37 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:09:37 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:09:37 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:09:37 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:09:37 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:09:37 user nova-compute[70645]:       <nova:owner>
Jul 24 15:09:37 user nova-compute[70645]:         <nova:user uuid="d9ba00b9477d416ba510bf66b424c1f9">tempest-AttachVolumeShelveTestJSON-218162714-project-member</nova:user>
Jul 24 15:09:37 user nova-compute[70645]:         <nova:project uuid="5d01222b2028429fae08bb542e5cd9cc">tempest-AttachVolumeShelveTestJSON-218162714</nova:project>
Jul 24 15:09:37 user nova-compute[70645]:       </nova:owner>
Jul 24 15:09:37 user nova-compute[70645]:       <nova:root type="image" uuid="41cf19b3-1d42-4ef5-9b47-a69d516afff3"/>
Jul 24 15:09:37 user nova-compute[70645]:       <nova:ports>
Jul 24 15:09:37 user nova-compute[70645]:         <nova:port uuid="65f3b461-6fb6-4333-a140-5935cdbed714">
Jul 24 15:09:37 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 15:09:37 user nova-compute[70645]:         </nova:port>
Jul 24 15:09:37 user nova-compute[70645]:       </nova:ports>
Jul 24 15:09:37 user nova-compute[70645]:     </nova:instance>
Jul 24 15:09:37 user nova-compute[70645]:   </metadata>
Jul 24 15:09:37 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:09:37 user nova-compute[70645]:     <system>
Jul 24 15:09:37 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:09:37 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:09:37 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:09:37 user nova-compute[70645]:       <entry name="serial">50dc20e7-65ef-4743-8707-9ef7da98f947</entry>
Jul 24 15:09:37 user nova-compute[70645]:       <entry name="uuid">50dc20e7-65ef-4743-8707-9ef7da98f947</entry>
Jul 24 15:09:37 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:09:37 user nova-compute[70645]:     </system>
Jul 24 15:09:37 user nova-compute[70645]:   </sysinfo>
Jul 24 15:09:37 user nova-compute[70645]:   <os>
Jul 24 15:09:37 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:09:37 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:09:37 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:09:37 user nova-compute[70645]:   </os>
Jul 24 15:09:37 user nova-compute[70645]:   <features>
Jul 24 15:09:37 user nova-compute[70645]:     <acpi/>
Jul 24 15:09:37 user nova-compute[70645]:     <apic/>
Jul 24 15:09:37 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:09:37 user nova-compute[70645]:   </features>
Jul 24 15:09:37 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:09:37 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:09:37 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:09:37 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:09:37 user nova-compute[70645]:   </clock>
Jul 24 15:09:37 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:09:37 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:09:37 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:09:37 user nova-compute[70645]:   </cpu>
Jul 24 15:09:37 user nova-compute[70645]:   <devices>
Jul 24 15:09:37 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:09:37 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:09:37 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk"/>
Jul 24 15:09:37 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:09:37 user nova-compute[70645]:     </disk>
Jul 24 15:09:37 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:09:37 user nova-compute[70645]:       <mac address="fa:16:3e:48:b6:04"/>
Jul 24 15:09:37 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:09:37 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:09:37 user nova-compute[70645]:       <target dev="tap65f3b461-6f"/>
Jul 24 15:09:37 user nova-compute[70645]:     </interface>
Jul 24 15:09:37 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:09:37 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/console.log" append="off"/>
Jul 24 15:09:37 user nova-compute[70645]:     </serial>
Jul 24 15:09:37 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:09:37 user nova-compute[70645]:     <video>
Jul 24 15:09:37 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:09:37 user nova-compute[70645]:     </video>
Jul 24 15:09:37 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:09:37 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:09:37 user nova-compute[70645]:     </rng>
Jul 24 15:09:37 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:09:37 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:09:37 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:09:37 user nova-compute[70645]:     </memballoon>
Jul 24 15:09:37 user nova-compute[70645]:   </devices>
Jul 24 15:09:37 user nova-compute[70645]: </domain>
Jul 24 15:09:37 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T15:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330489753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330489753',id=31,image_ref='41cf19b3-1d42-4ef5-9b47-a69d516afff3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1407958414',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-h40p6unj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member',shelved_at='2023-07-24T15:07:42.186807',shelved_host='user',shelved_image_id='41cf19b3-1d42-4ef5-9b47-a69d516afff3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:09:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=50dc20e7-65ef-4743-8707-9ef7da98f947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG os_vif [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65f3b461-6f, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65f3b461-6f, col_values=(('external_ids', {'iface-id': '65f3b461-6fb6-4333-a140-5935cdbed714', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:b6:04', 'vm-uuid': '50dc20e7-65ef-4743-8707-9ef7da98f947'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:37 user nova-compute[70645]: INFO os_vif [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f')
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:09:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] No VIF found with MAC fa:16:3e:48:b6:04, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:09:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-74a2dc40-09c2-4e7a-82c2-134aee6a523d req-8961cf5c-75f4-4a56-b67e-4c5d5d1e1316 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-74a2dc40-09c2-4e7a-82c2-134aee6a523d req-8961cf5c-75f4-4a56-b67e-4c5d5d1e1316 service nova] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-74a2dc40-09c2-4e7a-82c2-134aee6a523d req-8961cf5c-75f4-4a56-b67e-4c5d5d1e1316 service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-74a2dc40-09c2-4e7a-82c2-134aee6a523d req-8961cf5c-75f4-4a56-b67e-4c5d5d1e1316 service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-74a2dc40-09c2-4e7a-82c2-134aee6a523d req-8961cf5c-75f4-4a56-b67e-4c5d5d1e1316 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] No waiting events found dispatching network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:09:39 user nova-compute[70645]: WARNING nova.compute.manager [req-74a2dc40-09c2-4e7a-82c2-134aee6a523d req-8961cf5c-75f4-4a56-b67e-4c5d5d1e1316 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received unexpected event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 15:09:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:40 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211365.5539124, 4f686b79-b22d-4453-ae35-7a1133d7aa86 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:09:40 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] VM Stopped (Lifecycle Event)
Jul 24 15:09:40 user nova-compute[70645]: DEBUG nova.compute.manager [None req-32416688-1b29-450a-93d6-7ae323e0c88a None None] [instance: 4f686b79-b22d-4453-ae35-7a1133d7aa86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-0021a9e9-af19-47f3-a47f-1b20533ab6a5 req-f66493b8-7bf1-4493-8275-f10c1e9ca026 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0021a9e9-af19-47f3-a47f-1b20533ab6a5 req-f66493b8-7bf1-4493-8275-f10c1e9ca026 service nova] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0021a9e9-af19-47f3-a47f-1b20533ab6a5 req-f66493b8-7bf1-4493-8275-f10c1e9ca026 service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0021a9e9-af19-47f3-a47f-1b20533ab6a5 req-f66493b8-7bf1-4493-8275-f10c1e9ca026 service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-0021a9e9-af19-47f3-a47f-1b20533ab6a5 req-f66493b8-7bf1-4493-8275-f10c1e9ca026 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] No waiting events found dispatching network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:09:41 user nova-compute[70645]: WARNING nova.compute.manager [req-0021a9e9-af19-47f3-a47f-1b20533ab6a5 req-f66493b8-7bf1-4493-8275-f10c1e9ca026 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received unexpected event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 15:09:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:09:41 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Creating image(s)
Jul 24 15:09:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Ensure instance console log exists: /opt/stack/data/nova/instances/012bb476-47bc-4bfc-96aa-c53fe1d7de6e/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Start _get_guest_xml network_info=[{"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5a1f8855-b993-4abe-bb4a-ea7faf3922ec', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoxSDjbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '012bb476-47bc-4bfc-96aa-c53fe1d7de6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd287b2a0-2700-4b84-8cc5-4ba3e83faffe', 'serial': 'd287b2a0-2700-4b84-8cc5-4ba3e83faffe'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:09:41 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:09:41 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:09:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:09:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoxSDjbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:09:42 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:09:42 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:09:42 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ba8918-16ea-45ff-b213-48ebe4482466]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:09:42 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a632b4-77ca-454f-9f24-be21c1abe02a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe] added
Jul 24 15:09:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211382.1085045, 50dc20e7-65ef-4743-8707-9ef7da98f947 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:09:42 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] VM Resumed (Lifecycle Event)
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dcd626-77fb-4e14-9982-5e8912b34e2b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:42 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Instance spawned successfully.
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7157a2-9fd0-4e0d-beaa-505730dc9bc0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoxSDjbT {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:42 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211382.1119685, 50dc20e7-65ef-4743-8707-9ef7da98f947 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:09:42 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] VM Started (Lifecycle Event)
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoxSDjbT" returned: 0 in 0.035s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed47212b-c0e7-4702-b2d1-c1d28534bde8]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FoxSDjbT'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[be15a16a-c47a-4033-a177-8a68d3c0429e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:09:42 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c50cea-1011-4a54-86be-3f33543da636]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:09:42 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:09:42 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:09:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:09:42 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:09:42 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:09:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce094f7-b78a-45e3-8206-620cdf1a0e8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260]
Jul 24 15:09:42 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260] successful.
Jul 24 15:09:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[814c1022-2bb3-40a7-b3d4-f76d5290b227]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e427b9-c9e4-44b8-b41e-4199e0f47ad6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:09:42 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:09:42 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:09:42 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:09:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:09:42 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:09:42 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:09:42 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:09:42 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d4f5c-5184-4e63-a700-fd1163066d07]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoxSDjbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-979edc9a-8f12-4e5a-91b8-7e8a36cf0651 tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.150s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '26466366432346564', 'path': '/dev/sdd'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466366432346564', 'path': '/dev/sdd'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1065436731',display_name='tempest-TestShelveInstance-server-1065436731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1065436731',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRi8VGO3j6KnekRSs2bYS3PuYQyHaFasE9r8zCC1CvdS8fQqrYI4K3kKProSoPH3NKf0nIsY/OWOnRSUw25COR+NZrS6VpiPyJSwm2iFgvZQVGXw/yH+aAoqsabm3Ukg==',key_name='tempest-TestShelveInstance-1650283485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2680ac44b8394d5c8e1b086884cb61f1',ramdisk_id='',reservation_id='r-j0ksgdvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2062206678',owner_user_name='tempest-TestShelveInstance-2062206678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:09:35Z,user_data=None,user_id='6a73120d16244c85b13ec468bca3c982',uuid=012bb476-47bc-4bfc-96aa-c53fe1d7de6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converting VIF {"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lazy-loading 'pci_devices' on Instance uuid 012bb476-47bc-4bfc-96aa-c53fe1d7de6e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:09:43 user nova-compute[70645]:   <uuid>012bb476-47bc-4bfc-96aa-c53fe1d7de6e</uuid>
Jul 24 15:09:43 user nova-compute[70645]:   <name>instance-00000023</name>
Jul 24 15:09:43 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:09:43 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:09:43 user nova-compute[70645]:   <metadata>
Jul 24 15:09:43 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:09:43 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:09:43 user nova-compute[70645]:       <nova:name>tempest-TestShelveInstance-server-1065436731</nova:name>
Jul 24 15:09:43 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:09:41</nova:creationTime>
Jul 24 15:09:43 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:09:43 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:09:43 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:09:43 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:09:43 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:09:43 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:09:43 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:09:43 user nova-compute[70645]:       <nova:owner>
Jul 24 15:09:43 user nova-compute[70645]:         <nova:user uuid="6a73120d16244c85b13ec468bca3c982">tempest-TestShelveInstance-2062206678-project-member</nova:user>
Jul 24 15:09:43 user nova-compute[70645]:         <nova:project uuid="2680ac44b8394d5c8e1b086884cb61f1">tempest-TestShelveInstance-2062206678</nova:project>
Jul 24 15:09:43 user nova-compute[70645]:       </nova:owner>
Jul 24 15:09:43 user nova-compute[70645]:       <nova:ports>
Jul 24 15:09:43 user nova-compute[70645]:         <nova:port uuid="33997fc3-0a55-4ace-8e42-d1d57ae5f66f">
Jul 24 15:09:43 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 15:09:43 user nova-compute[70645]:         </nova:port>
Jul 24 15:09:43 user nova-compute[70645]:       </nova:ports>
Jul 24 15:09:43 user nova-compute[70645]:     </nova:instance>
Jul 24 15:09:43 user nova-compute[70645]:   </metadata>
Jul 24 15:09:43 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:09:43 user nova-compute[70645]:     <system>
Jul 24 15:09:43 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:09:43 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:09:43 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:09:43 user nova-compute[70645]:       <entry name="serial">012bb476-47bc-4bfc-96aa-c53fe1d7de6e</entry>
Jul 24 15:09:43 user nova-compute[70645]:       <entry name="uuid">012bb476-47bc-4bfc-96aa-c53fe1d7de6e</entry>
Jul 24 15:09:43 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:09:43 user nova-compute[70645]:     </system>
Jul 24 15:09:43 user nova-compute[70645]:   </sysinfo>
Jul 24 15:09:43 user nova-compute[70645]:   <os>
Jul 24 15:09:43 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:09:43 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:09:43 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:09:43 user nova-compute[70645]:   </os>
Jul 24 15:09:43 user nova-compute[70645]:   <features>
Jul 24 15:09:43 user nova-compute[70645]:     <acpi/>
Jul 24 15:09:43 user nova-compute[70645]:     <apic/>
Jul 24 15:09:43 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:09:43 user nova-compute[70645]:   </features>
Jul 24 15:09:43 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:09:43 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:09:43 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:09:43 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:09:43 user nova-compute[70645]:   </clock>
Jul 24 15:09:43 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:09:43 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:09:43 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:09:43 user nova-compute[70645]:   </cpu>
Jul 24 15:09:43 user nova-compute[70645]:   <devices>
Jul 24 15:09:43 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:09:43 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:09:43 user nova-compute[70645]:       <source dev="/dev/sdd"/>
Jul 24 15:09:43 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:09:43 user nova-compute[70645]:       <serial>d287b2a0-2700-4b84-8cc5-4ba3e83faffe</serial>
Jul 24 15:09:43 user nova-compute[70645]:     </disk>
Jul 24 15:09:43 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:09:43 user nova-compute[70645]:       <mac address="fa:16:3e:c6:84:18"/>
Jul 24 15:09:43 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:09:43 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:09:43 user nova-compute[70645]:       <target dev="tap33997fc3-0a"/>
Jul 24 15:09:43 user nova-compute[70645]:     </interface>
Jul 24 15:09:43 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:09:43 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/012bb476-47bc-4bfc-96aa-c53fe1d7de6e/console.log" append="off"/>
Jul 24 15:09:43 user nova-compute[70645]:     </serial>
Jul 24 15:09:43 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:09:43 user nova-compute[70645]:     <video>
Jul 24 15:09:43 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:09:43 user nova-compute[70645]:     </video>
Jul 24 15:09:43 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:09:43 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:09:43 user nova-compute[70645]:     </rng>
Jul 24 15:09:43 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:09:43 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:09:43 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:09:43 user nova-compute[70645]:     </memballoon>
Jul 24 15:09:43 user nova-compute[70645]:   </devices>
Jul 24 15:09:43 user nova-compute[70645]: </domain>
Jul 24 15:09:43 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1065436731',display_name='tempest-TestShelveInstance-server-1065436731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1065436731',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRi8VGO3j6KnekRSs2bYS3PuYQyHaFasE9r8zCC1CvdS8fQqrYI4K3kKProSoPH3NKf0nIsY/OWOnRSUw25COR+NZrS6VpiPyJSwm2iFgvZQVGXw/yH+aAoqsabm3Ukg==',key_name='tempest-TestShelveInstance-1650283485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2680ac44b8394d5c8e1b086884cb61f1',ramdisk_id='',reservation_id='r-j0ksgdvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2062206678',owner_user_name='tempest-TestShelveInstance-2062206678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:09:35Z,user_data=None,user_id='6a73120d16244c85b13ec468bca3c982',uuid=012bb476-47bc-4bfc-96aa-c53fe1d7de6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converting VIF {"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG os_vif [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33997fc3-0a, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33997fc3-0a, col_values=(('external_ids', {'iface-id': '33997fc3-0a55-4ace-8e42-d1d57ae5f66f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:84:18', 'vm-uuid': '012bb476-47bc-4bfc-96aa-c53fe1d7de6e'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:43 user nova-compute[70645]: INFO os_vif [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a')
Jul 24 15:09:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:09:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] No VIF found with MAC fa:16:3e:c6:84:18, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:09:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d935228-3139-4082-94ef-be101dabd81b req-ce997305-f2b2-4712-a181-0d707785be58 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d935228-3139-4082-94ef-be101dabd81b req-ce997305-f2b2-4712-a181-0d707785be58 service nova] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d935228-3139-4082-94ef-be101dabd81b req-ce997305-f2b2-4712-a181-0d707785be58 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d935228-3139-4082-94ef-be101dabd81b req-ce997305-f2b2-4712-a181-0d707785be58 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d935228-3139-4082-94ef-be101dabd81b req-ce997305-f2b2-4712-a181-0d707785be58 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] No waiting events found dispatching network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:09:45 user nova-compute[70645]: WARNING nova.compute.manager [req-8d935228-3139-4082-94ef-be101dabd81b req-ce997305-f2b2-4712-a181-0d707785be58 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received unexpected event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f for instance with vm_state building and task_state spawning.
Jul 24 15:09:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-4ceee080-c811-4750-83d3-2b9395e13c4f req-4efdb2d7-f2f1-424e-ad97-1b58af6cd9c9 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4ceee080-c811-4750-83d3-2b9395e13c4f req-4efdb2d7-f2f1-424e-ad97-1b58af6cd9c9 service nova] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4ceee080-c811-4750-83d3-2b9395e13c4f req-4efdb2d7-f2f1-424e-ad97-1b58af6cd9c9 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4ceee080-c811-4750-83d3-2b9395e13c4f req-4efdb2d7-f2f1-424e-ad97-1b58af6cd9c9 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-4ceee080-c811-4750-83d3-2b9395e13c4f req-4efdb2d7-f2f1-424e-ad97-1b58af6cd9c9 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] No waiting events found dispatching network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:09:47 user nova-compute[70645]: WARNING nova.compute.manager [req-4ceee080-c811-4750-83d3-2b9395e13c4f req-4efdb2d7-f2f1-424e-ad97-1b58af6cd9c9 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received unexpected event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f for instance with vm_state building and task_state spawning.
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211387.259103, 012bb476-47bc-4bfc-96aa-c53fe1d7de6e => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:09:47 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] VM Resumed (Lifecycle Event)
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:09:47 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Instance spawned successfully.
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:09:47 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211387.2601728, 012bb476-47bc-4bfc-96aa-c53fe1d7de6e => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:09:47 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] VM Started (Lifecycle Event)
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:09:47 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:09:47 user nova-compute[70645]: INFO nova.compute.manager [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Took 5.46 seconds to spawn the instance on the hypervisor.
Jul 24 15:09:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:09:47 user nova-compute[70645]: INFO nova.compute.manager [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Took 14.76 seconds to build instance.
Jul 24 15:09:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0ebb10fa-1f88-4b35-b0f8-17975b55f369 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.921s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:09:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:09:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "07adce07-b416-44fb-b548-17b8cd0d8168" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "07adce07-b416-44fb-b548-17b8cd0d8168" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:15 user nova-compute[70645]: INFO nova.compute.manager [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Terminating instance
Jul 24 15:10:15 user nova-compute[70645]: DEBUG nova.compute.manager [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:10:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-392f7395-88fa-4a24-a09a-52727bb22985 req-7ad2ff80-98e8-4526-8f48-2e3269cf6b43 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Received event network-vif-unplugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-392f7395-88fa-4a24-a09a-52727bb22985 req-7ad2ff80-98e8-4526-8f48-2e3269cf6b43 service nova] Acquiring lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-392f7395-88fa-4a24-a09a-52727bb22985 req-7ad2ff80-98e8-4526-8f48-2e3269cf6b43 service nova] Lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-392f7395-88fa-4a24-a09a-52727bb22985 req-7ad2ff80-98e8-4526-8f48-2e3269cf6b43 service nova] Lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-392f7395-88fa-4a24-a09a-52727bb22985 req-7ad2ff80-98e8-4526-8f48-2e3269cf6b43 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] No waiting events found dispatching network-vif-unplugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-392f7395-88fa-4a24-a09a-52727bb22985 req-7ad2ff80-98e8-4526-8f48-2e3269cf6b43 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Received event network-vif-unplugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:16 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Instance destroyed successfully.
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.objects.instance [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'resources' on Instance uuid 07adce07-b416-44fb-b548-17b8cd0d8168 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1648115033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1648115033',id=24,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-8kltig5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:02:50Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=07adce07-b416-44fb-b548-17b8cd0d8168,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "address": "fa:16:3e:9f:16:10", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3258aab1-f0", "ovs_interfaceid": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "address": "fa:16:3e:9f:16:10", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3258aab1-f0", "ovs_interfaceid": "3258aab1-f0f0-4794-9ca4-1979321a98f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:16:10,bridge_name='br-int',has_traffic_filtering=True,id=3258aab1-f0f0-4794-9ca4-1979321a98f0,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3258aab1-f0') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG os_vif [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:16:10,bridge_name='br-int',has_traffic_filtering=True,id=3258aab1-f0f0-4794-9ca4-1979321a98f0,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3258aab1-f0') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3258aab1-f0, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:16 user nova-compute[70645]: INFO os_vif [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:16:10,bridge_name='br-int',has_traffic_filtering=True,id=3258aab1-f0f0-4794-9ca4-1979321a98f0,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3258aab1-f0')
Jul 24 15:10:16 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Deleting instance files /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168_del
Jul 24 15:10:16 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Deletion of /opt/stack/data/nova/instances/07adce07-b416-44fb-b548-17b8cd0d8168_del complete
Jul 24 15:10:16 user nova-compute[70645]: INFO nova.compute.manager [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Took 0.66 seconds to destroy the instance on the hypervisor.
Jul 24 15:10:16 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:10:16 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Took 0.44 seconds to deallocate network for instance.
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-89e184e1-1118-4f9c-b4ca-df4fd474fb53 req-36cdf3be-c606-447c-89d9-c61fbb42e928 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Received event network-vif-deleted-3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:10:16 user nova-compute[70645]: INFO nova.compute.manager [req-89e184e1-1118-4f9c-b4ca-df4fd474fb53 req-36cdf3be-c606-447c-89d9-c61fbb42e928 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Neutron deleted interface 3258aab1-f0f0-4794-9ca4-1979321a98f0; detaching it from the instance and deleting it from the info cache
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.network.neutron [req-89e184e1-1118-4f9c-b4ca-df4fd474fb53 req-36cdf3be-c606-447c-89d9-c61fbb42e928 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-89e184e1-1118-4f9c-b4ca-df4fd474fb53 req-36cdf3be-c606-447c-89d9-c61fbb42e928 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Detach interface failed, port_id=3258aab1-f0f0-4794-9ca4-1979321a98f0, reason: Instance 07adce07-b416-44fb-b548-17b8cd0d8168 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:17 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:10:17 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:10:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:17 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Deleted allocations for instance 07adce07-b416-44fb-b548-17b8cd0d8168
Jul 24 15:10:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36f2865f-11f2-49c3-baa9-51e4218f20ee tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "07adce07-b416-44fb-b548-17b8cd0d8168" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.596s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-0c445383-3b03-4a97-a37b-d22968b74306 req-f4a5755f-d611-43a9-96e3-3c4b453e7449 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Received event network-vif-plugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:10:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0c445383-3b03-4a97-a37b-d22968b74306 req-f4a5755f-d611-43a9-96e3-3c4b453e7449 service nova] Acquiring lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0c445383-3b03-4a97-a37b-d22968b74306 req-f4a5755f-d611-43a9-96e3-3c4b453e7449 service nova] Lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0c445383-3b03-4a97-a37b-d22968b74306 req-f4a5755f-d611-43a9-96e3-3c4b453e7449 service nova] Lock "07adce07-b416-44fb-b548-17b8cd0d8168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-0c445383-3b03-4a97-a37b-d22968b74306 req-f4a5755f-d611-43a9-96e3-3c4b453e7449 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] No waiting events found dispatching network-vif-plugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:10:18 user nova-compute[70645]: WARNING nova.compute.manager [req-0c445383-3b03-4a97-a37b-d22968b74306 req-f4a5755f-d611-43a9-96e3-3c4b453e7449 service nova] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Received unexpected event network-vif-plugged-3258aab1-f0f0-4794-9ca4-1979321a98f0 for instance with vm_state deleted and task_state None.
Jul 24 15:10:20 user nova-compute[70645]: INFO nova.compute.manager [None req-cd39b9cb-b991-4f64-91e9-8f9fa20b3e32 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Unrescuing
Jul 24 15:10:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-cd39b9cb-b991-4f64-91e9-8f9fa20b3e32 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:10:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-cd39b9cb-b991-4f64-91e9-8f9fa20b3e32 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquired lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:10:20 user nova-compute[70645]: DEBUG nova.network.neutron [None req-cd39b9cb-b991-4f64-91e9-8f9fa20b3e32 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:10:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:21 user nova-compute[70645]: DEBUG nova.network.neutron [None req-cd39b9cb-b991-4f64-91e9-8f9fa20b3e32 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updating instance_info_cache with network_info: [{"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:10:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-cd39b9cb-b991-4f64-91e9-8f9fa20b3e32 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Releasing lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:10:21 user nova-compute[70645]: DEBUG nova.objects.instance [None req-cd39b9cb-b991-4f64-91e9-8f9fa20b3e32 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'flavor' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:10:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-08141674-d735-4659-b966-b291a6a51039 req-d9776df9-efbb-4c75-8d20-fb0fbfad46ce service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-unplugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:10:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-08141674-d735-4659-b966-b291a6a51039 req-d9776df9-efbb-4c75-8d20-fb0fbfad46ce service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-08141674-d735-4659-b966-b291a6a51039 req-d9776df9-efbb-4c75-8d20-fb0fbfad46ce service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-08141674-d735-4659-b966-b291a6a51039 req-d9776df9-efbb-4c75-8d20-fb0fbfad46ce service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-08141674-d735-4659-b966-b291a6a51039 req-d9776df9-efbb-4c75-8d20-fb0fbfad46ce service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-unplugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:10:21 user nova-compute[70645]: WARNING nova.compute.manager [req-08141674-d735-4659-b966-b291a6a51039 req-d9776df9-efbb-4c75-8d20-fb0fbfad46ce service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received unexpected event network-vif-unplugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:10:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:22 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Instance destroyed successfully.
Jul 24 15:10:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-0d28d64c-7920-4e20-80f5-1cdc2dc37137 req-40fe26f9-ce33-4995-9f49-0921dd59b0db service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:10:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0d28d64c-7920-4e20-80f5-1cdc2dc37137 req-40fe26f9-ce33-4995-9f49-0921dd59b0db service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0d28d64c-7920-4e20-80f5-1cdc2dc37137 req-40fe26f9-ce33-4995-9f49-0921dd59b0db service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0d28d64c-7920-4e20-80f5-1cdc2dc37137 req-40fe26f9-ce33-4995-9f49-0921dd59b0db service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-0d28d64c-7920-4e20-80f5-1cdc2dc37137 req-40fe26f9-ce33-4995-9f49-0921dd59b0db service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:10:23 user nova-compute[70645]: WARNING nova.compute.manager [req-0d28d64c-7920-4e20-80f5-1cdc2dc37137 req-40fe26f9-ce33-4995-9f49-0921dd59b0db service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received unexpected event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with vm_state rescued and task_state unrescuing.
Jul 24 15:10:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:25 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:10:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 15:10:25 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211425.9005477, 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:10:25 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] VM Resumed (Lifecycle Event)
Jul 24 15:10:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-cd39b9cb-b991-4f64-91e9-8f9fa20b3e32 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:10:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:25 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:10:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:10:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:10:25 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 15:10:25 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211425.9036314, 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:10:25 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] VM Started (Lifecycle Event)
Jul 24 15:10:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:10:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:10:26 user nova-compute[70645]: WARNING nova.compute.manager [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received unexpected event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with vm_state active and task_state None.
Jul 24 15:10:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:10:26 user nova-compute[70645]: WARNING nova.compute.manager [req-3e13cf3c-ffc5-4e94-ac7f-04fc8c5a34e5 req-37df8f2c-f6a6-4df1-93ec-d7d2d77855fd service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received unexpected event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with vm_state active and task_state None.
Jul 24 15:10:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:10:29 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:10:29 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7457MB free_disk=25.273067474365234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 82005166-20b9-4dce-b0fe-812766f1670d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance aad9c89c-c216-4329-8457-c1057ab17ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 50dc20e7-65ef-4743-8707-9ef7da98f947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 012bb476-47bc-4bfc-96aa-c53fe1d7de6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:10:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:10:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:10:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:10:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:10:30 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:10:31 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211416.3136845, 07adce07-b416-44fb-b548-17b8cd0d8168 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:10:31 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] VM Stopped (Lifecycle Event)
Jul 24 15:10:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-47cb16d8-ed28-43cf-a63a-7546be4ee2e8 None None] [instance: 07adce07-b416-44fb-b548-17b8cd0d8168] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:10:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Updating instance_info_cache with network_info: [{"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:10:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-cf8bcde0-6825-45f0-85c3-14188211558c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:10:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:10:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:10:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:10:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:10:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:10:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:10:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:10:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:10:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:10:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:10:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:10:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:10:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:42 user nova-compute[70645]: INFO nova.compute.manager [None req-f8664011-c809-4bf5-a550-ad1bed360f63 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Get console output
Jul 24 15:10:43 user nova-compute[70645]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 24 15:10:44 user nova-compute[70645]: DEBUG nova.compute.manager [req-13000103-0319-4494-ae82-45b61738b740 req-5d25b18a-f0e8-4bad-b122-da084b721f9e service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Received event network-changed-18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:10:44 user nova-compute[70645]: DEBUG nova.compute.manager [req-13000103-0319-4494-ae82-45b61738b740 req-5d25b18a-f0e8-4bad-b122-da084b721f9e service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Refreshing instance network info cache due to event network-changed-18ca2b69-127c-416b-8604-118d00ceac1f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:10:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-13000103-0319-4494-ae82-45b61738b740 req-5d25b18a-f0e8-4bad-b122-da084b721f9e service nova] Acquiring lock "refresh_cache-aad9c89c-c216-4329-8457-c1057ab17ec8" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:10:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-13000103-0319-4494-ae82-45b61738b740 req-5d25b18a-f0e8-4bad-b122-da084b721f9e service nova] Acquired lock "refresh_cache-aad9c89c-c216-4329-8457-c1057ab17ec8" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:10:44 user nova-compute[70645]: DEBUG nova.network.neutron [req-13000103-0319-4494-ae82-45b61738b740 req-5d25b18a-f0e8-4bad-b122-da084b721f9e service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Refreshing network info cache for port 18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:10:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-13000103-0319-4494-ae82-45b61738b740 req-5d25b18a-f0e8-4bad-b122-da084b721f9e service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Updated VIF entry in instance network info cache for port 18ca2b69-127c-416b-8604-118d00ceac1f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:10:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-13000103-0319-4494-ae82-45b61738b740 req-5d25b18a-f0e8-4bad-b122-da084b721f9e service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Updating instance_info_cache with network_info: [{"id": "18ca2b69-127c-416b-8604-118d00ceac1f", "address": "fa:16:3e:8a:b5:9c", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ca2b69-12", "ovs_interfaceid": "18ca2b69-127c-416b-8604-118d00ceac1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:10:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-13000103-0319-4494-ae82-45b61738b740 req-5d25b18a-f0e8-4bad-b122-da084b721f9e service nova] Releasing lock "refresh_cache-aad9c89c-c216-4329-8457-c1057ab17ec8" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:10:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG nova.objects.instance [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:47 user nova-compute[70645]: INFO nova.compute.manager [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Attaching volume c3a62823-344c-486b-bb98-a6d3fddd94b0 to /dev/vdb
Jul 24 15:10:47 user nova-compute[70645]: DEBUG os_brick.utils [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcb132f-b4de-474c-b177-927b5576a3f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[25729036-78cb-4b41-ab41-3c489a38ece1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ddcd5c-0f53-4662-aa9e-786317c3be7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d8aa1c-fcf0-4ac5-8d6c-a54f47cb1ac5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:10:47 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:10:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd7de59-6225-4638-8ae6-bd47c2c9d9eb]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG os_brick.utils [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Updating existing volume attachment record: d93839ce-6c67-4e2d-896c-b179566bfb98 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:10:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWJkdHnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:10:54 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:10:54 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:10:54 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de39750-bd8d-4632-895b-66858c4e8e9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:10:54 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[67937b5b-3b04-4371-ad06-f489cc2f7ae0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0] added
Jul 24 15:10:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[937fedf1-508f-41e9-b4e8-9ca18cc913e0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf1bf3-c286-4b8b-87a0-dd955c1fecda]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWJkdHnR {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWJkdHnR" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab1b4a0-3a8a-4af2-adce-d368dde5902b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QWJkdHnR'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[60642242-da02-4679-b1b9-d6a876eacc8d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[de617afe-f857-430a-a1d0-9fbe5e740554]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:10:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:10:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3c6d7f-e095-4501-ba90-a3e70b90f5a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0, portal: 172.16.0.220,3260]
Jul 24 15:10:54 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0, portal: 172.16.0.220,3260] successful.
Jul 24 15:10:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62632ab-f4e6-475f-bd0c-42ce4cee3195]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6916103d-491c-4a70-aec2-3160f8875d7e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)
Jul 24 15:10:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:10:54 user nova-compute[70645]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)
Jul 24 15:10:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5063f47-4c24-4a9c-98c5-04a30da2fe2e]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:10:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWJkdHnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:10:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:10:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26636633137376533', 'path': '/dev/sde'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:10:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636633137376533', 'path': '/dev/sde'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:10:55 user nova-compute[70645]: DEBUG nova.objects.instance [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:10:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:10:55 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:10:55 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:10:55 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:10:55 user nova-compute[70645]:   <serial>c3a62823-344c-486b-bb98-a6d3fddd94b0</serial>
Jul 24 15:10:55 user nova-compute[70645]: </disk>
Jul 24 15:10:55 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:10:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:10:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:10:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No VIF found with MAC fa:16:3e:8a:b5:9c, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:10:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6bea6359-38a2-4eeb-b559-762ec5314f56 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.511s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:10:58 user nova-compute[70645]: INFO nova.compute.manager [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Attaching volume 3fff746a-38f4-46ca-b15b-648cb350f307 to /dev/vdc
Jul 24 15:10:58 user nova-compute[70645]: DEBUG os_brick.utils [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e73bf8-9b92-47aa-8b6d-ef6d0846e853]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de1d36-a58c-4b32-b26a-83c817c88941]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4071cc41-6829-44ff-ad23-4bda818dd5e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a9846a-8c8b-4e90-a84b-b8a22669acd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:10:58 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:10:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[852d874f-5d1c-46e5-a57e-0c0c8c2fcd73]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:10:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:10:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:10:59 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:10:59 user nova-compute[70645]: DEBUG os_brick.utils [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:10:59 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Updating existing volume attachment record: 8575adf4-ecdc-4047-964f-b34de0ddf9ee {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:11:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFjVwJxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:11:05 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:11:05 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:11:05 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7383fa42-a66c-4e93-9fc4-d58114a18841]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:11:05 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edf7a90-a570-4eb0-979f-472409bc257a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307] added
Jul 24 15:11:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[31de20a7-8bdf-415b-956c-19085227ac13]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5256429-2148-4f52-a9d2-bc943c73a7b4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZFjVwJxB {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZFjVwJxB" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a613d2-ec70-42b2-b8fa-7ab2f6acb21d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZFjVwJxB'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d8565-94aa-46f8-9905-7509d5c70a2a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9fbc40-3232-4374-94c6-f044d261b1b9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7df7163-945a-44a0-8934-6ab086a1d454]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307, portal: 172.16.0.220,3260]
Jul 24 15:11:05 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307, portal: 172.16.0.220,3260] successful.
Jul 24 15:11:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0432f828-da61-4735-836a-d5a21913f21e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4383d42e-3f88-4180-a2d3-792edc2b4372]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)
Jul 24 15:11:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8e548a-0cf9-4067-99de-77daa2aaca11]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:11:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFjVwJxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:06 user nova-compute[70645]: INFO nova.compute.manager [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Terminating instance
Jul 24 15:11:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-fd676c34-6f85-4d66-b7a2-26841fc284ee req-b7c45484-6f97-45b5-8364-1ee9f03864f8 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-unplugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd676c34-6f85-4d66-b7a2-26841fc284ee req-b7c45484-6f97-45b5-8364-1ee9f03864f8 service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd676c34-6f85-4d66-b7a2-26841fc284ee req-b7c45484-6f97-45b5-8364-1ee9f03864f8 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd676c34-6f85-4d66-b7a2-26841fc284ee req-b7c45484-6f97-45b5-8364-1ee9f03864f8 service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-fd676c34-6f85-4d66-b7a2-26841fc284ee req-b7c45484-6f97-45b5-8364-1ee9f03864f8 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-unplugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-fd676c34-6f85-4d66-b7a2-26841fc284ee req-b7c45484-6f97-45b5-8364-1ee9f03864f8 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-unplugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23237303135323038', 'path': '/dev/sdf'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:11:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237303135323038', 'path': '/dev/sdf'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:11:06 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Instance destroyed successfully.
Jul 24 15:11:06 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'resources' on Instance uuid 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1295668391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1295668391',id=13,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:57:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-fe9sxf4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:59:06Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=10b586d2-6bff-4cb5-bde5-b8fdc035ff07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "376b3d27-e524-41f9-916f-1a3901da8eec", "address": "fa:16:3e:a2:0f:85", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376b3d27-e5", "ovs_interfaceid": "376b3d27-e524-41f9-916f-1a3901da8eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:0f:85,bridge_name='br-int',has_traffic_filtering=True,id=376b3d27-e524-41f9-916f-1a3901da8eec,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376b3d27-e5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_vif [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:0f:85,bridge_name='br-int',has_traffic_filtering=True,id=376b3d27-e524-41f9-916f-1a3901da8eec,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376b3d27-e5') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap376b3d27-e5, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:11:07 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:11:07 user nova-compute[70645]:   <source dev="/dev/sdf"/>
Jul 24 15:11:07 user nova-compute[70645]:   <target dev="vdc" bus="virtio"/>
Jul 24 15:11:07 user nova-compute[70645]:   <serial>3fff746a-38f4-46ca-b15b-648cb350f307</serial>
Jul 24 15:11:07 user nova-compute[70645]: </disk>
Jul 24 15:11:07 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:11:07 user nova-compute[70645]: INFO os_vif [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:0f:85,bridge_name='br-int',has_traffic_filtering=True,id=376b3d27-e524-41f9-916f-1a3901da8eec,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376b3d27-e5')
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROnGTIAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:11:07 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa356db-6305-43a2-a9bc-49424baabe0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c01f685-f099-46aa-a90c-7dedd16d265f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:11:07 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:07 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:07 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:07 user nova-compute[70645]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)
Jul 24 15:11:07 user nova-compute[70645]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)
Jul 24 15:11:07 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 (non-flash)
Jul 24 15:11:07 user nova-compute[70645]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:07 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:07 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:07 user nova-compute[70645]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)
Jul 24 15:11:07 user nova-compute[70645]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)
Jul 24 15:11:07 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba60765750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3'): ({'sdk'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Removing single pathed devices sdk {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[323fcb64-e55e-4317-9e3d-c13224751f8c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c13eff8-dc45-4783-acc0-665202ef4c04]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Flushing IO for device /dev/sdk {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a98a4ac-997a-4eac-becc-56482b425618]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.032s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d67c5a-ce8f-42c0-aa38-4cbceda25043]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] SCSI volumes sdk have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1750da7f-0026-47f7-9ef7-b49719f6ef2a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76bc424-54b9-41fc-bc16-3dedca78ee79]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3, portal: 172.16.0.220,3260]
Jul 24 15:11:07 user nova-compute[70645]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3, portal: 172.16.0.220,3260] successful.
Jul 24 15:11:07 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a968748b-0bec-460a-bb02-bc7d4774f0c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe60cc2d-1e26-4a89-89ca-0e58df3c537c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] <== disconnect_volume: return (293ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:11:07 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Deleting instance files /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07_del
Jul 24 15:11:07 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Deletion of /opt/stack/data/nova/instances/10b586d2-6bff-4cb5-bde5-b8fdc035ff07_del complete
Jul 24 15:11:07 user nova-compute[70645]: INFO nova.compute.manager [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] No VIF found with MAC fa:16:3e:8a:b5:9c, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d9614464-46a1-42a0-9a93-9a0407a693c3 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.790s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:11:07 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Took 0.49 seconds to deallocate network for instance.
Jul 24 15:11:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-00bc60d2-9fde-4db2-8d8e-c5864530ddc3 req-45d6a548-e388-4a53-925f-dc4685accfa4 service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-deleted-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:08 user nova-compute[70645]: DEBUG nova.compute.manager [req-8bb1ce64-cdb0-4afc-8366-e4561b3932be req-9fb4bef0-0d13-4311-afe7-0aa79a5c3b8b service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8bb1ce64-cdb0-4afc-8366-e4561b3932be req-9fb4bef0-0d13-4311-afe7-0aa79a5c3b8b service nova] Acquiring lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8bb1ce64-cdb0-4afc-8366-e4561b3932be req-9fb4bef0-0d13-4311-afe7-0aa79a5c3b8b service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8bb1ce64-cdb0-4afc-8366-e4561b3932be req-9fb4bef0-0d13-4311-afe7-0aa79a5c3b8b service nova] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:08 user nova-compute[70645]: DEBUG nova.compute.manager [req-8bb1ce64-cdb0-4afc-8366-e4561b3932be req-9fb4bef0-0d13-4311-afe7-0aa79a5c3b8b service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] No waiting events found dispatching network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:08 user nova-compute[70645]: WARNING nova.compute.manager [req-8bb1ce64-cdb0-4afc-8366-e4561b3932be req-9fb4bef0-0d13-4311-afe7-0aa79a5c3b8b service nova] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Received unexpected event network-vif-plugged-376b3d27-e524-41f9-916f-1a3901da8eec for instance with vm_state active and task_state deleting.
Jul 24 15:11:08 user nova-compute[70645]: INFO nova.compute.manager [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Took 0.73 seconds to detach 1 volumes for instance.
Jul 24 15:11:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:08 user nova-compute[70645]: INFO nova.compute.manager [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Detaching volume c3a62823-344c-486b-bb98-a6d3fddd94b0
Jul 24 15:11:08 user nova-compute[70645]: INFO nova.virt.block_device [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Attempting to driver detach volume c3a62823-344c-486b-bb98-a6d3fddd94b0 from mountpoint /dev/vdb
Jul 24 15:11:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Attempting to detach device vdb from instance aad9c89c-c216-4329-8457-c1057ab17ec8 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:11:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:11:08 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:11:08 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:11:08 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:11:08 user nova-compute[70645]:   <serial>c3a62823-344c-486b-bb98-a6d3fddd94b0</serial>
Jul 24 15:11:08 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:11:08 user nova-compute[70645]: </disk>
Jul 24 15:11:08 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:11:08 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully detached device vdb from instance aad9c89c-c216-4329-8457-c1057ab17ec8 from the persistent domain config.
Jul 24 15:11:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aad9c89c-c216-4329-8457-c1057ab17ec8 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:11:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:11:08 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:11:08 user nova-compute[70645]:   <source dev="/dev/sde"/>
Jul 24 15:11:08 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:11:08 user nova-compute[70645]:   <serial>c3a62823-344c-486b-bb98-a6d3fddd94b0</serial>
Jul 24 15:11:08 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:11:08 user nova-compute[70645]: </disk>
Jul 24 15:11:08 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:09 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Deleted allocations for instance 10b586d2-6bff-4cb5-bde5-b8fdc035ff07
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d2b6cfa-b4cc-4abb-8aec-7f51b56af558 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "10b586d2-6bff-4cb5-bde5-b8fdc035ff07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.957s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211469.411411, aad9c89c-c216-4329-8457-c1057ab17ec8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:11:09 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully detached device vdb from instance aad9c89c-c216-4329-8457-c1057ab17ec8 from the live domain config.
Jul 24 15:11:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWJkdHnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:11:09 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cac55b9-1582-457b-9a83-7473814e9c3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd82339-4059-45ed-88ea-8956b3907e2d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:09 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:09 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:09 user nova-compute[70645]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)
Jul 24 15:11:09 user nova-compute[70645]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)
Jul 24 15:11:09 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:09 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:09 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:09 user nova-compute[70645]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 (non-flash)
Jul 24 15:11:09 user nova-compute[70645]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)
Jul 24 15:11:09 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba840fcaf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0'): ({'sde'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Removing single pathed devices sde {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd0119e-8473-4a46-b052-c0213203de7b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c92e03-2fcf-4289-8a1d-ffbe77869196]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flushing IO for device /dev/sde {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[633a3366-53e9-4cf6-bae6-5ded6811881f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e211761a-4ff9-497f-a818-db9d1a089e9e]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] SCSI volumes sde have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[06501b2c-9e2b-4aa3-af82-b2e5b281e96c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.122s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[272e6825-1236-4b2e-927f-368fd5a6a1d0]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0, portal: 172.16.0.220,3260]
Jul 24 15:11:09 user nova-compute[70645]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0, portal: 172.16.0.220,3260] successful.
Jul 24 15:11:09 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a62823-344c-486b-bb98-a6d3fddd94b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0fa663-1bba-4335-a2ac-877d5b91c8dd]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] <== disconnect_volume: return (378ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:11:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:11:10 user nova-compute[70645]: DEBUG nova.objects.instance [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:11:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-64025fe6-00d6-4f60-b9a6-f49c4f2dd00c tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:11 user nova-compute[70645]: INFO nova.compute.manager [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Detaching volume 3fff746a-38f4-46ca-b15b-648cb350f307
Jul 24 15:11:11 user nova-compute[70645]: INFO nova.virt.block_device [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Attempting to driver detach volume 3fff746a-38f4-46ca-b15b-648cb350f307 from mountpoint /dev/vdc
Jul 24 15:11:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Attempting to detach device vdc from instance aad9c89c-c216-4329-8457-c1057ab17ec8 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:11:11 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:11:11 user nova-compute[70645]:   <source dev="/dev/sdf"/>
Jul 24 15:11:11 user nova-compute[70645]:   <target dev="vdc" bus="virtio"/>
Jul 24 15:11:11 user nova-compute[70645]:   <serial>3fff746a-38f4-46ca-b15b-648cb350f307</serial>
Jul 24 15:11:11 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 15:11:11 user nova-compute[70645]: </disk>
Jul 24 15:11:11 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:11:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully detached device vdc from instance aad9c89c-c216-4329-8457-c1057ab17ec8 from the persistent domain config.
Jul 24 15:11:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance aad9c89c-c216-4329-8457-c1057ab17ec8 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:11:11 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:11:11 user nova-compute[70645]:   <source dev="/dev/sdf"/>
Jul 24 15:11:11 user nova-compute[70645]:   <target dev="vdc" bus="virtio"/>
Jul 24 15:11:11 user nova-compute[70645]:   <serial>3fff746a-38f4-46ca-b15b-648cb350f307</serial>
Jul 24 15:11:11 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 15:11:11 user nova-compute[70645]: </disk>
Jul 24 15:11:11 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211471.8108797, aad9c89c-c216-4329-8457-c1057ab17ec8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:11:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully detached device vdc from instance aad9c89c-c216-4329-8457-c1057ab17ec8 from the live domain config.
Jul 24 15:11:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFjVwJxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:11:11 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e142f-4ab4-4043-b734-f1dd0b6071a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca4c784-f4fd-4b5c-b646-c23384e09fd9]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:11 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:11 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:11 user nova-compute[70645]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)
Jul 24 15:11:11 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:11 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:11 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:11 user nova-compute[70645]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 (non-flash)
Jul 24 15:11:11 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba9c60c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307'): ({'sdf'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Removing single pathed devices sdf {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40f69e7-848b-49d7-9503-18a03c6391b2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[714eb364-0f4a-4c30-b81d-f21426aebe19]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Flushing IO for device /dev/sdf {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c39a467-825d-4485-b8c9-877c522568e2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[184ffd60-4524-40f0-97a3-4198245debd6]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] SCSI volumes sdf have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:11:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[87549c78-69aa-40db-9611-f39a2dac4ab4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f92727a-19df-4ab4-bd60-0eeacf6c26b1]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307, portal: 172.16.0.220,3260]
Jul 24 15:11:12 user nova-compute[70645]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307, portal: 172.16.0.220,3260] successful.
Jul 24 15:11:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fff746a-38f4-46ca-b15b-648cb350f307 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffff74d2-5fc6-4843-ac2d-aa8c7fc6b685]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] <== disconnect_volume: return (278ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG nova.objects.instance [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'flavor' on Instance uuid aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6d8c09af-263c-4ffd-b8e1-a29d17fc9a60 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.553s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:13 user nova-compute[70645]: INFO nova.compute.manager [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Terminating instance
Jul 24 15:11:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:11:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-76d0f4c3-2511-4a79-ab24-b8f10bd68166 req-4180e7c3-f44b-4b89-900b-36110f104771 service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Received event network-vif-unplugged-18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-76d0f4c3-2511-4a79-ab24-b8f10bd68166 req-4180e7c3-f44b-4b89-900b-36110f104771 service nova] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-76d0f4c3-2511-4a79-ab24-b8f10bd68166 req-4180e7c3-f44b-4b89-900b-36110f104771 service nova] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-76d0f4c3-2511-4a79-ab24-b8f10bd68166 req-4180e7c3-f44b-4b89-900b-36110f104771 service nova] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-76d0f4c3-2511-4a79-ab24-b8f10bd68166 req-4180e7c3-f44b-4b89-900b-36110f104771 service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] No waiting events found dispatching network-vif-unplugged-18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG nova.compute.manager [req-76d0f4c3-2511-4a79-ab24-b8f10bd68166 req-4180e7c3-f44b-4b89-900b-36110f104771 service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Received event network-vif-unplugged-18ca2b69-127c-416b-8604-118d00ceac1f for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:11:14 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Instance destroyed successfully.
Jul 24 15:11:14 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lazy-loading 'resources' on Instance uuid aad9c89c-c216-4329-8457-c1057ab17ec8 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1564163967',display_name='tempest-AttachVolumeTestJSON-server-1564163967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1564163967',id=34,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7YyolXS6pGWfpcHWTeJ2vAYnAuiwOCCoKbADmomA5RC73gpCDcgFczFmQ54R1l+CFPner+J0PLtA9ldRVQNA/JMLZbunpS5dlUTX//b0P+g+6yBFXuMoVnRNdxrDDhgA==',key_name='tempest-keypair-1406990156',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2dacb396f6be4936ac1c4d115bf98d6a',ramdisk_id='',reservation_id='r-cft27uws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1397935195',owner_user_name='tempest-AttachVolumeTestJSON-1397935195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:09:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa4b836a11a044a583cb21072f0e4922',uuid=aad9c89c-c216-4329-8457-c1057ab17ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18ca2b69-127c-416b-8604-118d00ceac1f", "address": "fa:16:3e:8a:b5:9c", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ca2b69-12", "ovs_interfaceid": "18ca2b69-127c-416b-8604-118d00ceac1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converting VIF {"id": "18ca2b69-127c-416b-8604-118d00ceac1f", "address": "fa:16:3e:8a:b5:9c", "network": {"id": "d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-680357952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dacb396f6be4936ac1c4d115bf98d6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ca2b69-12", "ovs_interfaceid": "18ca2b69-127c-416b-8604-118d00ceac1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=18ca2b69-127c-416b-8604-118d00ceac1f,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ca2b69-12') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG os_vif [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=18ca2b69-127c-416b-8604-118d00ceac1f,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ca2b69-12') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18ca2b69-12, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:14 user nova-compute[70645]: INFO os_vif [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=18ca2b69-127c-416b-8604-118d00ceac1f,network=Network(d4a4fa6f-3a3a-4eb3-8168-a0f0e8b702b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ca2b69-12')
Jul 24 15:11:14 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Deleting instance files /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8_del
Jul 24 15:11:14 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Deletion of /opt/stack/data/nova/instances/aad9c89c-c216-4329-8457-c1057ab17ec8_del complete
Jul 24 15:11:14 user nova-compute[70645]: INFO nova.compute.manager [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 24 15:11:14 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:11:14 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:11:15 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:11:15 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Took 0.83 seconds to deallocate network for instance.
Jul 24 15:11:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:15 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:11:15 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:11:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:16 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Deleted allocations for instance aad9c89c-c216-4329-8457-c1057ab17ec8
Jul 24 15:11:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c6d37d6d-6c95-4e54-8a68-dd1c98ab2011 tempest-AttachVolumeTestJSON-1397935195 tempest-AttachVolumeTestJSON-1397935195-project-member] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-bf8e355d-2ff6-4e5a-9b38-52ed9af9501e req-70e3d50c-ebd0-4b98-aec5-6de012769d39 service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Received event network-vif-plugged-18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bf8e355d-2ff6-4e5a-9b38-52ed9af9501e req-70e3d50c-ebd0-4b98-aec5-6de012769d39 service nova] Acquiring lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bf8e355d-2ff6-4e5a-9b38-52ed9af9501e req-70e3d50c-ebd0-4b98-aec5-6de012769d39 service nova] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bf8e355d-2ff6-4e5a-9b38-52ed9af9501e req-70e3d50c-ebd0-4b98-aec5-6de012769d39 service nova] Lock "aad9c89c-c216-4329-8457-c1057ab17ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-bf8e355d-2ff6-4e5a-9b38-52ed9af9501e req-70e3d50c-ebd0-4b98-aec5-6de012769d39 service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] No waiting events found dispatching network-vif-plugged-18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:16 user nova-compute[70645]: WARNING nova.compute.manager [req-bf8e355d-2ff6-4e5a-9b38-52ed9af9501e req-70e3d50c-ebd0-4b98-aec5-6de012769d39 service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Received unexpected event network-vif-plugged-18ca2b69-127c-416b-8604-118d00ceac1f for instance with vm_state deleted and task_state None.
Jul 24 15:11:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-bf8e355d-2ff6-4e5a-9b38-52ed9af9501e req-70e3d50c-ebd0-4b98-aec5-6de012769d39 service nova] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Received event network-vif-deleted-18ca2b69-127c-416b-8604-118d00ceac1f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:20 user nova-compute[70645]: INFO nova.compute.manager [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Terminating instance
Jul 24 15:11:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-67e46483-a8af-476b-9359-614750da8ded req-1c1b5b4d-d185-4bca-a423-f5916749d0ba service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-vif-unplugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-67e46483-a8af-476b-9359-614750da8ded req-1c1b5b4d-d185-4bca-a423-f5916749d0ba service nova] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-67e46483-a8af-476b-9359-614750da8ded req-1c1b5b4d-d185-4bca-a423-f5916749d0ba service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-67e46483-a8af-476b-9359-614750da8ded req-1c1b5b4d-d185-4bca-a423-f5916749d0ba service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-67e46483-a8af-476b-9359-614750da8ded req-1c1b5b4d-d185-4bca-a423-f5916749d0ba service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] No waiting events found dispatching network-vif-unplugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-67e46483-a8af-476b-9359-614750da8ded req-1c1b5b4d-d185-4bca-a423-f5916749d0ba service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-vif-unplugged-65f3b461-6fb6-4333-a140-5935cdbed714 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:11:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Instance destroyed successfully.
Jul 24 15:11:21 user nova-compute[70645]: DEBUG nova.objects.instance [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lazy-loading 'resources' on Instance uuid 50dc20e7-65ef-4743-8707-9ef7da98f947 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T15:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330489753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330489753',id=31,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaXAroQ4BdTvsI0tcXXaibpJpjFI70qBUNCYaWNBQ2yL3snJ4LkWJiVjr8FxamHsO0VuKXioe3d0VYrb0hT4AInm7bicj8DShVjS8c3e60SA9BG30+FFh/DCXsUzU+fDA==',key_name='tempest-keypair-1407958414',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d01222b2028429fae08bb542e5cd9cc',ramdisk_id='',reservation_id='r-h40p6unj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-218162714',owner_user_name='tempest-AttachVolumeShelveTestJSON-218162714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba00b9477d416ba510bf66b424c1f9',uuid=50dc20e7-65ef-4743-8707-9ef7da98f947,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converting VIF {"id": "65f3b461-6fb6-4333-a140-5935cdbed714", "address": "fa:16:3e:48:b6:04", "network": {"id": "c1daa97a-36bd-4996-a3cd-f8d4077f1ddd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630513287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d01222b2028429fae08bb542e5cd9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f3b461-6f", "ovs_interfaceid": "65f3b461-6fb6-4333-a140-5935cdbed714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG os_vif [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65f3b461-6f, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:21 user nova-compute[70645]: INFO os_vif [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:04,bridge_name='br-int',has_traffic_filtering=True,id=65f3b461-6fb6-4333-a140-5935cdbed714,network=Network(c1daa97a-36bd-4996-a3cd-f8d4077f1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f3b461-6f')
Jul 24 15:11:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Deleting instance files /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947_del
Jul 24 15:11:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Deletion of /opt/stack/data/nova/instances/50dc20e7-65ef-4743-8707-9ef7da98f947_del complete
Jul 24 15:11:21 user nova-compute[70645]: INFO nova.compute.manager [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Took 0.66 seconds to destroy the instance on the hypervisor.
Jul 24 15:11:21 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:11:21 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211466.987591, 10b586d2-6bff-4cb5-bde5-b8fdc035ff07 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:11:21 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] VM Stopped (Lifecycle Event)
Jul 24 15:11:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8377c82e-749d-4fb6-ae34-7f268c0f0066 None None] [instance: 10b586d2-6bff-4cb5-bde5-b8fdc035ff07] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:11:22 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:11:22 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Took 1.09 seconds to deallocate network for instance.
Jul 24 15:11:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-b0e666c3-556d-4821-b447-49d8e65c572d req-c8ccc31d-9d32-43f9-a512-b48871a88302 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-vif-deleted-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:23 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:11:23 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:11:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:23 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Deleted allocations for instance 50dc20e7-65ef-4743-8707-9ef7da98f947
Jul 24 15:11:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e0e60fd8-c113-4e78-b952-0ff355f5f00d tempest-AttachVolumeShelveTestJSON-218162714 tempest-AttachVolumeShelveTestJSON-218162714-project-member] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.332s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-8bb8fd66-0ff7-4566-b1c1-377a236f9ee3 req-c370a3fe-a32f-4b09-9663-6703d9600a39 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8bb8fd66-0ff7-4566-b1c1-377a236f9ee3 req-c370a3fe-a32f-4b09-9663-6703d9600a39 service nova] Acquiring lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8bb8fd66-0ff7-4566-b1c1-377a236f9ee3 req-c370a3fe-a32f-4b09-9663-6703d9600a39 service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8bb8fd66-0ff7-4566-b1c1-377a236f9ee3 req-c370a3fe-a32f-4b09-9663-6703d9600a39 service nova] Lock "50dc20e7-65ef-4743-8707-9ef7da98f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-8bb8fd66-0ff7-4566-b1c1-377a236f9ee3 req-c370a3fe-a32f-4b09-9663-6703d9600a39 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] No waiting events found dispatching network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:23 user nova-compute[70645]: WARNING nova.compute.manager [req-8bb8fd66-0ff7-4566-b1c1-377a236f9ee3 req-c370a3fe-a32f-4b09-9663-6703d9600a39 service nova] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Received unexpected event network-vif-plugged-65f3b461-6fb6-4333-a140-5935cdbed714 for instance with vm_state deleted and task_state None.
Jul 24 15:11:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-eb5aa65c-aeb9-4ffa-8c1a-62f4587b79bd req-b2e031aa-3d01-4a6f-9d61-e8f5ef73dff5 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-changed-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-eb5aa65c-aeb9-4ffa-8c1a-62f4587b79bd req-b2e031aa-3d01-4a6f-9d61-e8f5ef73dff5 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Refreshing instance network info cache due to event network-changed-33997fc3-0a55-4ace-8e42-d1d57ae5f66f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-eb5aa65c-aeb9-4ffa-8c1a-62f4587b79bd req-b2e031aa-3d01-4a6f-9d61-e8f5ef73dff5 service nova] Acquiring lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-eb5aa65c-aeb9-4ffa-8c1a-62f4587b79bd req-b2e031aa-3d01-4a6f-9d61-e8f5ef73dff5 service nova] Acquired lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG nova.network.neutron [req-eb5aa65c-aeb9-4ffa-8c1a-62f4587b79bd req-b2e031aa-3d01-4a6f-9d61-e8f5ef73dff5 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Refreshing network info cache for port 33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG nova.network.neutron [req-eb5aa65c-aeb9-4ffa-8c1a-62f4587b79bd req-b2e031aa-3d01-4a6f-9d61-e8f5ef73dff5 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updated VIF entry in instance network info cache for port 33997fc3-0a55-4ace-8e42-d1d57ae5f66f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG nova.network.neutron [req-eb5aa65c-aeb9-4ffa-8c1a-62f4587b79bd req-b2e031aa-3d01-4a6f-9d61-e8f5ef73dff5 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating instance_info_cache with network_info: [{"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-eb5aa65c-aeb9-4ffa-8c1a-62f4587b79bd req-b2e031aa-3d01-4a6f-9d61-e8f5ef73dff5 service nova] Releasing lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:25 user nova-compute[70645]: INFO nova.compute.manager [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Shelve offloading
Jul 24 15:11:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-269060ec-b1f6-4f6c-a36d-abd4cb3d80c8 req-63ca22a0-082e-4443-9683-5849b1764c12 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-vif-unplugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-269060ec-b1f6-4f6c-a36d-abd4cb3d80c8 req-63ca22a0-082e-4443-9683-5849b1764c12 service nova] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-269060ec-b1f6-4f6c-a36d-abd4cb3d80c8 req-63ca22a0-082e-4443-9683-5849b1764c12 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-269060ec-b1f6-4f6c-a36d-abd4cb3d80c8 req-63ca22a0-082e-4443-9683-5849b1764c12 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-269060ec-b1f6-4f6c-a36d-abd4cb3d80c8 req-63ca22a0-082e-4443-9683-5849b1764c12 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] No waiting events found dispatching network-vif-unplugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:25 user nova-compute[70645]: WARNING nova.compute.manager [req-269060ec-b1f6-4f6c-a36d-abd4cb3d80c8 req-63ca22a0-082e-4443-9683-5849b1764c12 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received unexpected event network-vif-unplugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f for instance with vm_state active and task_state shelving.
Jul 24 15:11:26 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Instance destroyed successfully.
Jul 24 15:11:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:11:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:11:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquired lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:11:26 user nova-compute[70645]: DEBUG nova.network.neutron [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:11:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:11:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG nova.network.neutron [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating instance_info_cache with network_info: [{"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Releasing lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Instance destroyed successfully.
Jul 24 15:11:27 user nova-compute[70645]: DEBUG nova.objects.instance [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lazy-loading 'resources' on Instance uuid 012bb476-47bc-4bfc-96aa-c53fe1d7de6e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1065436731',display_name='tempest-TestShelveInstance-server-1065436731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1065436731',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRi8VGO3j6KnekRSs2bYS3PuYQyHaFasE9r8zCC1CvdS8fQqrYI4K3kKProSoPH3NKf0nIsY/OWOnRSUw25COR+NZrS6VpiPyJSwm2iFgvZQVGXw/yH+aAoqsabm3Ukg==',key_name='tempest-TestShelveInstance-1650283485',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:09:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2680ac44b8394d5c8e1b086884cb61f1',ramdisk_id='',reservation_id='r-j0ksgdvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2062206678',owner_user_name='tempest-TestShelveInstance-2062206678-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:09:48Z,user_data=None,user_id='6a73120d16244c85b13ec468bca3c982',uuid=012bb476-47bc-4bfc-96aa-c53fe1d7de6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converting VIF {"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_vif [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG nova.compute.manager [req-7264d509-0667-4c2b-aaf0-cdf3866ecb66 req-4c73bdb7-e48a-4755-a7ca-9b32987f4a04 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-changed-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG nova.compute.manager [req-7264d509-0667-4c2b-aaf0-cdf3866ecb66 req-4c73bdb7-e48a-4755-a7ca-9b32987f4a04 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Refreshing instance network info cache due to event network-changed-33997fc3-0a55-4ace-8e42-d1d57ae5f66f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7264d509-0667-4c2b-aaf0-cdf3866ecb66 req-4c73bdb7-e48a-4755-a7ca-9b32987f4a04 service nova] Acquiring lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7264d509-0667-4c2b-aaf0-cdf3866ecb66 req-4c73bdb7-e48a-4755-a7ca-9b32987f4a04 service nova] Acquired lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG nova.network.neutron [req-7264d509-0667-4c2b-aaf0-cdf3866ecb66 req-4c73bdb7-e48a-4755-a7ca-9b32987f4a04 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Refreshing network info cache for port 33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33997fc3-0a, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:11:27 user nova-compute[70645]: INFO os_vif [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a')
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoxSDjbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:11:27 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c9b306-54b8-4125-9612-ce7a1813a90e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0d5708-f8ef-4bdf-ad5f-292070c05660]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:27 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:27 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:27 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:27 user nova-compute[70645]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:11:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba84296320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe'): ({'sdd'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Removing single pathed devices sdd {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76716dc-fd93-4d6b-a940-cea103ab8f91]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[392f2a5c-00ce-4ac1-b61c-1e64b4f433b9]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Flushing IO for device /dev/sdd {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6222f5-caad-4385-8ba5-e23701ff1019]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e4ad88-66dc-478e-b9fb-ab13856fb55f]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11936be-db4e-496d-8994-b1e827e9135a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-5f206880-a187-477d-9c9d-b635c6e91dad req-76d7041d-3129-44b8-9e36-024e1b6bdfc3 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5f206880-a187-477d-9c9d-b635c6e91dad req-76d7041d-3129-44b8-9e36-024e1b6bdfc3 service nova] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5f206880-a187-477d-9c9d-b635c6e91dad req-76d7041d-3129-44b8-9e36-024e1b6bdfc3 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5f206880-a187-477d-9c9d-b635c6e91dad req-76d7041d-3129-44b8-9e36-024e1b6bdfc3 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-5f206880-a187-477d-9c9d-b635c6e91dad req-76d7041d-3129-44b8-9e36-024e1b6bdfc3 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] No waiting events found dispatching network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:28 user nova-compute[70645]: WARNING nova.compute.manager [req-5f206880-a187-477d-9c9d-b635c6e91dad req-76d7041d-3129-44b8-9e36-024e1b6bdfc3 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received unexpected event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f for instance with vm_state active and task_state shelving.
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8374545d-6491-4c16-a0cf-dfe908fcb37e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260]
Jul 24 15:11:28 user nova-compute[70645]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260] successful.
Jul 24 15:11:28 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e92ed9-3a37-4268-86df-9f9f35dfc404]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] <== disconnect_volume: return (349ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:11:28 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Deleting instance files /opt/stack/data/nova/instances/012bb476-47bc-4bfc-96aa-c53fe1d7de6e_del
Jul 24 15:11:28 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Deletion of /opt/stack/data/nova/instances/012bb476-47bc-4bfc-96aa-c53fe1d7de6e_del complete
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG nova.network.neutron [req-7264d509-0667-4c2b-aaf0-cdf3866ecb66 req-4c73bdb7-e48a-4755-a7ca-9b32987f4a04 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updated VIF entry in instance network info cache for port 33997fc3-0a55-4ace-8e42-d1d57ae5f66f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG nova.network.neutron [req-7264d509-0667-4c2b-aaf0-cdf3866ecb66 req-4c73bdb7-e48a-4755-a7ca-9b32987f4a04 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating instance_info_cache with network_info: [{"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": null, "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap33997fc3-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7264d509-0667-4c2b-aaf0-cdf3866ecb66 req-4c73bdb7-e48a-4755-a7ca-9b32987f4a04 service nova] Releasing lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:11:29 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:11:29 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7983MB free_disk=25.32647705078125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:29 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Deleted allocations for instance 012bb476-47bc-4bfc-96aa-c53fe1d7de6e
Jul 24 15:11:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance b13c0261-b25c-48ce-9245-fa43dadc1829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 82005166-20b9-4dce-b0fe-812766f1670d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.260s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.objects.instance [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lazy-loading 'numa_topology' on Instance uuid 012bb476-47bc-4bfc-96aa-c53fe1d7de6e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211474.6547632, aad9c89c-c216-4329-8457-c1057ab17ec8 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:11:29 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] VM Stopped (Lifecycle Event)
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fe339493-7d79-4eeb-a43a-95cd221903bb None None] [instance: aad9c89c-c216-4329-8457-c1057ab17ec8] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3fb45666-fb6c-4c18-b02e-af593197535b tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.170s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:11:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:11:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:11:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:11:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:11:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating instance_info_cache with network_info: [{"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:11:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-82005166-20b9-4dce-b0fe-812766f1670d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:11:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:11:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:11:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:11:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:11:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:11:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:11:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:33 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:11:33 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:11:36 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211481.5393817, 50dc20e7-65ef-4743-8707-9ef7da98f947 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:11:36 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] VM Stopped (Lifecycle Event)
Jul 24 15:11:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-132be3b3-9740-4bb2-8b75-05c7873ada6b None None] [instance: 50dc20e7-65ef-4743-8707-9ef7da98f947] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:11:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:37 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:11:41 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211486.4586546, 012bb476-47bc-4bfc-96aa-c53fe1d7de6e => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:11:41 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] VM Stopped (Lifecycle Event)
Jul 24 15:11:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ee369218-05d5-4e4b-abe1-b829d3688784 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:11:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:11:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "82005166-20b9-4dce-b0fe-812766f1670d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:43 user nova-compute[70645]: INFO nova.compute.manager [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Terminating instance
Jul 24 15:11:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:11:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG nova.compute.manager [req-fc337fa4-9f5e-430a-82ec-b64ea302bf91 req-5b6a785c-163b-46f5-8470-1d165a924bce service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-vif-unplugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fc337fa4-9f5e-430a-82ec-b64ea302bf91 req-5b6a785c-163b-46f5-8470-1d165a924bce service nova] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fc337fa4-9f5e-430a-82ec-b64ea302bf91 req-5b6a785c-163b-46f5-8470-1d165a924bce service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fc337fa4-9f5e-430a-82ec-b64ea302bf91 req-5b6a785c-163b-46f5-8470-1d165a924bce service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG nova.compute.manager [req-fc337fa4-9f5e-430a-82ec-b64ea302bf91 req-5b6a785c-163b-46f5-8470-1d165a924bce service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] No waiting events found dispatching network-vif-unplugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG nova.compute.manager [req-fc337fa4-9f5e-430a-82ec-b64ea302bf91 req-5b6a785c-163b-46f5-8470-1d165a924bce service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-vif-unplugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:44 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Instance destroyed successfully.
Jul 24 15:11:44 user nova-compute[70645]: DEBUG nova.objects.instance [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'resources' on Instance uuid 82005166-20b9-4dce-b0fe-812766f1670d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1826590044',display_name='tempest-ServerActionsTestOtherA-server-1826590044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1826590044',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-dqgn0mql',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=82005166-20b9-4dce-b0fe-812766f1670d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "address": "fa:16:3e:d8:fb:57", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ec9ae6-b6", "ovs_interfaceid": "55ec9ae6-b6b7-4768-96b8-fe5fafed148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_vif [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55ec9ae6-b6, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:11:44 user nova-compute[70645]: INFO os_vif [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fb:57,bridge_name='br-int',has_traffic_filtering=True,id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ec9ae6-b6')
Jul 24 15:11:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXEtuKaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:11:44 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[964bd993-d1e2-44e9-9383-583af03d5843]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d076d4-85ab-427d-bf7f-70d4bcd4e2f0]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:44 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:44 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc (non-flash)
Jul 24 15:11:44 user nova-compute[70645]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:11:44 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba840fc5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5560d5d8-ebfc-4566-9b65-45cff0efd9db]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad4f32f-f336-4ac1-8f09-9a5227a0c001]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebd8a9a-c430-41a3-bb06-999af81ebd2c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.087s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a7384e-a394-4f86-aa3d-8f93e98b72a8]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10c3a11-67ec-4406-8ebb-7a24f97f1105]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[065e1416-ffde-4667-ac7e-0bdf90bb03e2]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260]
Jul 24 15:11:44 user nova-compute[70645]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc, portal: 172.16.0.220,3260] successful.
Jul 24 15:11:44 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698cf0df-4652-47eb-ba65-289eec42a6fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5233853-2c12-4360-9ff1-bd0728410434]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] <== disconnect_volume: return (314ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:11:44 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Deleting instance files /opt/stack/data/nova/instances/82005166-20b9-4dce-b0fe-812766f1670d_del
Jul 24 15:11:44 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Deletion of /opt/stack/data/nova/instances/82005166-20b9-4dce-b0fe-812766f1670d_del complete
Jul 24 15:11:44 user nova-compute[70645]: INFO nova.compute.manager [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 24 15:11:44 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:11:44 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:11:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1a437d1-5868-4193-9ddb-7cfb1e4d376e req-8f01b361-54d9-4bac-b287-ccd96df2890d service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-vif-deleted-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:45 user nova-compute[70645]: INFO nova.compute.manager [req-f1a437d1-5868-4193-9ddb-7cfb1e4d376e req-8f01b361-54d9-4bac-b287-ccd96df2890d service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Neutron deleted interface 55ec9ae6-b6b7-4768-96b8-fe5fafed148f; detaching it from the instance and deleting it from the info cache
Jul 24 15:11:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-f1a437d1-5868-4193-9ddb-7cfb1e4d376e req-8f01b361-54d9-4bac-b287-ccd96df2890d service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:11:45 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:11:45 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Took 0.87 seconds to deallocate network for instance.
Jul 24 15:11:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1a437d1-5868-4193-9ddb-7cfb1e4d376e req-8f01b361-54d9-4bac-b287-ccd96df2890d service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Detach interface failed, port_id=55ec9ae6-b6b7-4768-96b8-fe5fafed148f, reason: Instance 82005166-20b9-4dce-b0fe-812766f1670d could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:11:46 user nova-compute[70645]: DEBUG nova.compute.manager [req-984fe44d-e1a7-4ac7-9b11-65dcd34daedb req-32cea4df-cc8d-4d5e-a9a3-c0604ea8df85 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-984fe44d-e1a7-4ac7-9b11-65dcd34daedb req-32cea4df-cc8d-4d5e-a9a3-c0604ea8df85 service nova] Acquiring lock "82005166-20b9-4dce-b0fe-812766f1670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-984fe44d-e1a7-4ac7-9b11-65dcd34daedb req-32cea4df-cc8d-4d5e-a9a3-c0604ea8df85 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-984fe44d-e1a7-4ac7-9b11-65dcd34daedb req-32cea4df-cc8d-4d5e-a9a3-c0604ea8df85 service nova] Lock "82005166-20b9-4dce-b0fe-812766f1670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:46 user nova-compute[70645]: DEBUG nova.compute.manager [req-984fe44d-e1a7-4ac7-9b11-65dcd34daedb req-32cea4df-cc8d-4d5e-a9a3-c0604ea8df85 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] No waiting events found dispatching network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:46 user nova-compute[70645]: WARNING nova.compute.manager [req-984fe44d-e1a7-4ac7-9b11-65dcd34daedb req-32cea4df-cc8d-4d5e-a9a3-c0604ea8df85 service nova] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Received unexpected event network-vif-plugged-55ec9ae6-b6b7-4768-96b8-fe5fafed148f for instance with vm_state active and task_state deleting.
Jul 24 15:11:46 user nova-compute[70645]: INFO nova.compute.manager [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Took 0.71 seconds to detach 1 volumes for instance.
Jul 24 15:11:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Deleting volume: 698cf0df-4652-47eb-ba65-289eec42a6fc {{(pid=70645) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 15:11:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:46 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:11:46 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:11:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:46 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Deleted allocations for instance 82005166-20b9-4dce-b0fe-812766f1670d
Jul 24 15:11:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-61823e00-edb6-4224-abf8-354c1464d56b tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "82005166-20b9-4dce-b0fe-812766f1670d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.296s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "b13c0261-b25c-48ce-9245-fa43dadc1829" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:56 user nova-compute[70645]: INFO nova.compute.manager [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Terminating instance
Jul 24 15:11:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-aa975173-5ada-4fea-b148-9fd34e2b6607 req-60da791c-79c5-4ed3-ab46-565b94efaebf service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Received event network-vif-unplugged-94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-aa975173-5ada-4fea-b148-9fd34e2b6607 req-60da791c-79c5-4ed3-ab46-565b94efaebf service nova] Acquiring lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-aa975173-5ada-4fea-b148-9fd34e2b6607 req-60da791c-79c5-4ed3-ab46-565b94efaebf service nova] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-aa975173-5ada-4fea-b148-9fd34e2b6607 req-60da791c-79c5-4ed3-ab46-565b94efaebf service nova] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-aa975173-5ada-4fea-b148-9fd34e2b6607 req-60da791c-79c5-4ed3-ab46-565b94efaebf service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] No waiting events found dispatching network-vif-unplugged-94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-aa975173-5ada-4fea-b148-9fd34e2b6607 req-60da791c-79c5-4ed3-ab46-565b94efaebf service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Received event network-vif-unplugged-94c06498-d47d-431b-9c83-3c6b7b50e1df for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:11:57 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Instance destroyed successfully.
Jul 24 15:11:57 user nova-compute[70645]: DEBUG nova.objects.instance [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lazy-loading 'resources' on Instance uuid b13c0261-b25c-48ce-9245-fa43dadc1829 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1062621372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1062621372',id=1,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bab8baa391424072ba5bcea7f54f0242',ramdisk_id='',reservation_id='r-v0rsh5p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:54:16Z,user_data=None,user_id='192b7bd8dd234dceadc22ba7bb092344',uuid=b13c0261-b25c-48ce-9245-fa43dadc1829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converting VIF {"id": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "address": "fa:16:3e:19:99:f2", "network": {"id": "a811a4bf-475f-42d4-afba-c262e8740062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1334214698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bab8baa391424072ba5bcea7f54f0242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c06498-d4", "ovs_interfaceid": "94c06498-d47d-431b-9c83-3c6b7b50e1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:99:f2,bridge_name='br-int',has_traffic_filtering=True,id=94c06498-d47d-431b-9c83-3c6b7b50e1df,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c06498-d4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG os_vif [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:99:f2,bridge_name='br-int',has_traffic_filtering=True,id=94c06498-d47d-431b-9c83-3c6b7b50e1df,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c06498-d4') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94c06498-d4, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:11:57 user nova-compute[70645]: INFO os_vif [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:99:f2,bridge_name='br-int',has_traffic_filtering=True,id=94c06498-d47d-431b-9c83-3c6b7b50e1df,network=Network(a811a4bf-475f-42d4-afba-c262e8740062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c06498-d4')
Jul 24 15:11:57 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Deleting instance files /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829_del
Jul 24 15:11:57 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Deletion of /opt/stack/data/nova/instances/b13c0261-b25c-48ce-9245-fa43dadc1829_del complete
Jul 24 15:11:57 user nova-compute[70645]: INFO nova.compute.manager [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Took 0.76 seconds to destroy the instance on the hypervisor.
Jul 24 15:11:57 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:11:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:11:58 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:11:58 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Took 0.42 seconds to deallocate network for instance.
Jul 24 15:11:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:58 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:11:58 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:11:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:58 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Deleted allocations for instance b13c0261-b25c-48ce-9245-fa43dadc1829
Jul 24 15:11:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-751f6676-85c5-41e5-8ed4-8f21b12c18f4 tempest-ServerBootFromVolumeStableRescueTest-1550895590 tempest-ServerBootFromVolumeStableRescueTest-1550895590-project-member] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.559s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-5f635fbd-f880-4997-abf1-baededae21d0 req-e567fc20-144b-4270-bff3-cb3eb9fb52b7 service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Received event network-vif-plugged-94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5f635fbd-f880-4997-abf1-baededae21d0 req-e567fc20-144b-4270-bff3-cb3eb9fb52b7 service nova] Acquiring lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:11:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5f635fbd-f880-4997-abf1-baededae21d0 req-e567fc20-144b-4270-bff3-cb3eb9fb52b7 service nova] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:11:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5f635fbd-f880-4997-abf1-baededae21d0 req-e567fc20-144b-4270-bff3-cb3eb9fb52b7 service nova] Lock "b13c0261-b25c-48ce-9245-fa43dadc1829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:11:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-5f635fbd-f880-4997-abf1-baededae21d0 req-e567fc20-144b-4270-bff3-cb3eb9fb52b7 service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] No waiting events found dispatching network-vif-plugged-94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:11:59 user nova-compute[70645]: WARNING nova.compute.manager [req-5f635fbd-f880-4997-abf1-baededae21d0 req-e567fc20-144b-4270-bff3-cb3eb9fb52b7 service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Received unexpected event network-vif-plugged-94c06498-d47d-431b-9c83-3c6b7b50e1df for instance with vm_state deleted and task_state None.
Jul 24 15:11:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-5f635fbd-f880-4997-abf1-baededae21d0 req-e567fc20-144b-4270-bff3-cb3eb9fb52b7 service nova] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Received event network-vif-deleted-94c06498-d47d-431b-9c83-3c6b7b50e1df {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:11:59 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211504.465362, 82005166-20b9-4dce-b0fe-812766f1670d => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:11:59 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] VM Stopped (Lifecycle Event)
Jul 24 15:11:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-291b08c0-50a4-459c-b60d-06b4e194a7d3 None None] [instance: 82005166-20b9-4dce-b0fe-812766f1670d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:12:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:12 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211517.5010285, b13c0261-b25c-48ce-9245-fa43dadc1829 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:12:12 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] VM Stopped (Lifecycle Event)
Jul 24 15:12:12 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8cbe22d4-aee1-4810-b222-52145e6f7c8c None None] [instance: b13c0261-b25c-48ce-9245-fa43dadc1829] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:12:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:13 user nova-compute[70645]: DEBUG nova.compute.manager [req-c647298d-15b8-4492-b988-73e44f990ff5 req-aee75a57-ac8f-4c97-80f7-9f6310083618 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-changed-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:12:13 user nova-compute[70645]: DEBUG nova.compute.manager [req-c647298d-15b8-4492-b988-73e44f990ff5 req-aee75a57-ac8f-4c97-80f7-9f6310083618 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Refreshing instance network info cache due to event network-changed-e5c114ae-433c-4886-8a50-0c01256585af. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:12:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c647298d-15b8-4492-b988-73e44f990ff5 req-aee75a57-ac8f-4c97-80f7-9f6310083618 service nova] Acquiring lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:12:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c647298d-15b8-4492-b988-73e44f990ff5 req-aee75a57-ac8f-4c97-80f7-9f6310083618 service nova] Acquired lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:12:13 user nova-compute[70645]: DEBUG nova.network.neutron [req-c647298d-15b8-4492-b988-73e44f990ff5 req-aee75a57-ac8f-4c97-80f7-9f6310083618 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Refreshing network info cache for port e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:12:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:12:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:12:13 user nova-compute[70645]: INFO nova.compute.manager [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Detaching volume 085f325c-c043-4cff-ad29-d93d93be5f80
Jul 24 15:12:13 user nova-compute[70645]: INFO nova.virt.block_device [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Attempting to driver detach volume 085f325c-c043-4cff-ad29-d93d93be5f80 from mountpoint /dev/vdb
Jul 24 15:12:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Attempting to detach device vdb from instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:12:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:12:13 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:12:13 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:12:13 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:12:13 user nova-compute[70645]:   <serial>085f325c-c043-4cff-ad29-d93d93be5f80</serial>
Jul 24 15:12:13 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:12:13 user nova-compute[70645]: </disk>
Jul 24 15:12:13 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:12:13 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Successfully detached device vdb from instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 from the persistent domain config.
Jul 24 15:12:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:12:13 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:12:13 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:12:13 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:12:13 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:12:13 user nova-compute[70645]:   <serial>085f325c-c043-4cff-ad29-d93d93be5f80</serial>
Jul 24 15:12:13 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:12:13 user nova-compute[70645]: </disk>
Jul 24 15:12:13 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG nova.network.neutron [req-c647298d-15b8-4492-b988-73e44f990ff5 req-aee75a57-ac8f-4c97-80f7-9f6310083618 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updated VIF entry in instance network info cache for port e5c114ae-433c-4886-8a50-0c01256585af. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG nova.network.neutron [req-c647298d-15b8-4492-b988-73e44f990ff5 req-aee75a57-ac8f-4c97-80f7-9f6310083618 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updating instance_info_cache with network_info: [{"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c647298d-15b8-4492-b988-73e44f990ff5 req-aee75a57-ac8f-4c97-80f7-9f6310083618 service nova] Releasing lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211534.3413754, 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:12:14 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Successfully detached device vdb from instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 from the live domain config.
Jul 24 15:12:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvfKXdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:12:14 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3eba3b-0c7e-48cb-8171-60de041589bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f04c683-67bc-49f1-b817-daa493f4d9c6]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:12:14 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 (non-flash)
Jul 24 15:12:14 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbaa1cc2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[346d9280-9d72-4d82-a84f-bfbbbeb86e99]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac4fe02-ae4d-4c28-97c0-cf7a87b819c0]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cd8023-9935-4bdc-9ddb-158bf2a057df]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2b2826-6609-4113-8645-f601fa007e24]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6367dcfe-a026-4023-b030-c01d97760fff]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed7f380-f200-478b-a759-a627b0587b49]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80, portal: 172.16.0.220,3260]
Jul 24 15:12:14 user nova-compute[70645]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80, portal: 172.16.0.220,3260] successful.
Jul 24 15:12:14 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085f325c-c043-4cff-ad29-d93d93be5f80 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1f4543-af07-4a39-8f13-74668e0058e5]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] <== disconnect_volume: return (314ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:12:14 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:12:15 user nova-compute[70645]: DEBUG nova.compute.manager [req-d37f7c60-e17b-4be3-9008-c310c54f39c4 req-ca5a9046-a5f0-4bac-8b2b-f68590039667 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-changed-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:12:15 user nova-compute[70645]: DEBUG nova.compute.manager [req-d37f7c60-e17b-4be3-9008-c310c54f39c4 req-ca5a9046-a5f0-4bac-8b2b-f68590039667 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Refreshing instance network info cache due to event network-changed-e5c114ae-433c-4886-8a50-0c01256585af. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:12:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d37f7c60-e17b-4be3-9008-c310c54f39c4 req-ca5a9046-a5f0-4bac-8b2b-f68590039667 service nova] Acquiring lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:12:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d37f7c60-e17b-4be3-9008-c310c54f39c4 req-ca5a9046-a5f0-4bac-8b2b-f68590039667 service nova] Acquired lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:12:15 user nova-compute[70645]: DEBUG nova.network.neutron [req-d37f7c60-e17b-4be3-9008-c310c54f39c4 req-ca5a9046-a5f0-4bac-8b2b-f68590039667 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Refreshing network info cache for port e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:12:15 user nova-compute[70645]: DEBUG nova.objects.instance [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'flavor' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:12:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-01eff18f-1501-45df-b4f1-88cf87155ee9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.691s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:12:15 user nova-compute[70645]: DEBUG nova.network.neutron [req-d37f7c60-e17b-4be3-9008-c310c54f39c4 req-ca5a9046-a5f0-4bac-8b2b-f68590039667 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updated VIF entry in instance network info cache for port e5c114ae-433c-4886-8a50-0c01256585af. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:12:15 user nova-compute[70645]: DEBUG nova.network.neutron [req-d37f7c60-e17b-4be3-9008-c310c54f39c4 req-ca5a9046-a5f0-4bac-8b2b-f68590039667 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updating instance_info_cache with network_info: [{"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:12:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d37f7c60-e17b-4be3-9008-c310c54f39c4 req-ca5a9046-a5f0-4bac-8b2b-f68590039667 service nova] Releasing lock "refresh_cache-271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:12:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:12:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:12:27 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:12:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:12:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:12:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:12:27 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:12:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:12:30 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:12:30 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:12:30 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8252MB free_disk=25.433124542236328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 20469e51-a240-48ea-bdf4-f7a59d129232 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:12:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:12:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:12:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:12:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:12:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:12:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:12:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:12:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-5bc347f4-5487-4e88-96d5-9b2f411cb1e4" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:12:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-5bc347f4-5487-4e88-96d5-9b2f411cb1e4" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:12:31 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:12:32 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Updating instance_info_cache with network_info: [{"id": "a605a24e-447e-4dac-af86-14d665fa2391", "address": "fa:16:3e:e3:ce:5e", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa605a24e-44", "ovs_interfaceid": "a605a24e-447e-4dac-af86-14d665fa2391", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:12:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-5bc347f4-5487-4e88-96d5-9b2f411cb1e4" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:12:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:12:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:12:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:12:33 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:12:33 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:12:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:12:37 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:12:38 user nova-compute[70645]: INFO nova.compute.manager [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Terminating instance
Jul 24 15:12:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-2bf92a84-f7e9-46db-8609-fd1919b596ce req-969a6aca-f810-4b55-916f-e3ea2400a8e0 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-vif-unplugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2bf92a84-f7e9-46db-8609-fd1919b596ce req-969a6aca-f810-4b55-916f-e3ea2400a8e0 service nova] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2bf92a84-f7e9-46db-8609-fd1919b596ce req-969a6aca-f810-4b55-916f-e3ea2400a8e0 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2bf92a84-f7e9-46db-8609-fd1919b596ce req-969a6aca-f810-4b55-916f-e3ea2400a8e0 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-2bf92a84-f7e9-46db-8609-fd1919b596ce req-969a6aca-f810-4b55-916f-e3ea2400a8e0 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] No waiting events found dispatching network-vif-unplugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-2bf92a84-f7e9-46db-8609-fd1919b596ce req-969a6aca-f810-4b55-916f-e3ea2400a8e0 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-vif-unplugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:38 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Instance destroyed successfully.
Jul 24 15:12:38 user nova-compute[70645]: DEBUG nova.objects.instance [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lazy-loading 'resources' on Instance uuid 20469e51-a240-48ea-bdf4-f7a59d129232 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T14:56:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1375956069',display_name='tempest-ServerActionsTestOtherA-server-1144815694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1375956069',id=16,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiVDY1fMurqOWLwd4BjdQVxDpPf9PE6uJGAPpEqx+X24tgfSLgEE3Cxhy6CJn9MimQN/oDFpSbm9cJFEhrNEsLHWqUC1811w/O/zHYKqIZtIFOlSWv0mkPFo3IrOhLzQ==',key_name='tempest-keypair-1441289650',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:00:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f863d6c0aad845139d04b550254d59e3',ramdisk_id='',reservation_id='r-wu79uln7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1886739574',owner_user_name='tempest-ServerActionsTestOtherA-1886739574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43cd7067d09747f9b80cec22154a0e93',uuid=20469e51-a240-48ea-bdf4-f7a59d129232,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converting VIF {"id": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "address": "fa:16:3e:c0:95:67", "network": {"id": "93b6a555-55f4-4f41-972f-3cc2021d0f1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-577354223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f863d6c0aad845139d04b550254d59e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254aef5a-c4", "ovs_interfaceid": "254aef5a-c4f8-473b-a2c0-6db998ebc479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG os_vif [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap254aef5a-c4, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:12:38 user nova-compute[70645]: INFO os_vif [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:95:67,bridge_name='br-int',has_traffic_filtering=True,id=254aef5a-c4f8-473b-a2c0-6db998ebc479,network=Network(93b6a555-55f4-4f41-972f-3cc2021d0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254aef5a-c4')
Jul 24 15:12:38 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Deleting instance files /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232_del
Jul 24 15:12:38 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Deletion of /opt/stack/data/nova/instances/20469e51-a240-48ea-bdf4-f7a59d129232_del complete
Jul 24 15:12:39 user nova-compute[70645]: INFO nova.compute.manager [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 24 15:12:39 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:12:39 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:12:39 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:12:39 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:12:39 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Took 0.80 seconds to deallocate network for instance.
Jul 24 15:12:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-c1ebb15c-d046-43b6-8986-e118a4cc18ed req-b2e0823d-d789-486a-918f-431e0f3c88b2 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-vif-deleted-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:12:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:12:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:12:40 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:12:40 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:12:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:12:40 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Deleted allocations for instance 20469e51-a240-48ea-bdf4-f7a59d129232
Jul 24 15:12:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-df3cd12c-319b-424f-9f5e-c6f6980ebaa5 tempest-ServerActionsTestOtherA-1886739574 tempest-ServerActionsTestOtherA-1886739574-project-member] Lock "20469e51-a240-48ea-bdf4-f7a59d129232" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.209s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:12:40 user nova-compute[70645]: DEBUG nova.compute.manager [req-8f577217-1307-454c-87bb-378c7cbefc2c req-346e3fee-5f54-4293-a0a7-df1f1b08f2a0 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:12:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8f577217-1307-454c-87bb-378c7cbefc2c req-346e3fee-5f54-4293-a0a7-df1f1b08f2a0 service nova] Acquiring lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:12:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8f577217-1307-454c-87bb-378c7cbefc2c req-346e3fee-5f54-4293-a0a7-df1f1b08f2a0 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:12:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8f577217-1307-454c-87bb-378c7cbefc2c req-346e3fee-5f54-4293-a0a7-df1f1b08f2a0 service nova] Lock "20469e51-a240-48ea-bdf4-f7a59d129232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:12:40 user nova-compute[70645]: DEBUG nova.compute.manager [req-8f577217-1307-454c-87bb-378c7cbefc2c req-346e3fee-5f54-4293-a0a7-df1f1b08f2a0 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] No waiting events found dispatching network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:12:40 user nova-compute[70645]: WARNING nova.compute.manager [req-8f577217-1307-454c-87bb-378c7cbefc2c req-346e3fee-5f54-4293-a0a7-df1f1b08f2a0 service nova] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Received unexpected event network-vif-plugged-254aef5a-c4f8-473b-a2c0-6db998ebc479 for instance with vm_state deleted and task_state None.
Jul 24 15:12:41 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:12:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:12:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:53 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211558.9174728, 20469e51-a240-48ea-bdf4-f7a59d129232 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:12:53 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] VM Stopped (Lifecycle Event)
Jul 24 15:12:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-5ea8f2f5-6318-4d63-a8bd-c87cb15a9e73 None None] [instance: 20469e51-a240-48ea-bdf4-f7a59d129232] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:12:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:12:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:13:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:04 user nova-compute[70645]: INFO nova.compute.manager [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Terminating instance
Jul 24 15:13:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-1e12fdfa-9f85-40bd-b882-6c9be39977f3 req-f2b25a54-1620-43fa-b987-125ea7dc0213 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-unplugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1e12fdfa-9f85-40bd-b882-6c9be39977f3 req-f2b25a54-1620-43fa-b987-125ea7dc0213 service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1e12fdfa-9f85-40bd-b882-6c9be39977f3 req-f2b25a54-1620-43fa-b987-125ea7dc0213 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1e12fdfa-9f85-40bd-b882-6c9be39977f3 req-f2b25a54-1620-43fa-b987-125ea7dc0213 service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-1e12fdfa-9f85-40bd-b882-6c9be39977f3 req-f2b25a54-1620-43fa-b987-125ea7dc0213 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-unplugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-1e12fdfa-9f85-40bd-b882-6c9be39977f3 req-f2b25a54-1620-43fa-b987-125ea7dc0213 service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-unplugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Instance destroyed successfully.
Jul 24 15:13:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'resources' on Instance uuid 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-682817805',display_name='tempest-ServerRescueNegativeTestJSON-server-682817805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-682817805',id=32,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONsBzgzH8OSaVH0EufkBS4/tqJwCDScyZHEPq7KVN2duIQjhyV4RSbbUo7s/YWEOXmmyUj4zOGsIkLga0IXalBEY4yu30RqKaDrugQXXQjX8kKFWpucjI6SQ0mE6fffJQ==',key_name='tempest-keypair-1103917478',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:08:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-pvr9zonq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "e5c114ae-433c-4886-8a50-0c01256585af", "address": "fa:16:3e:d4:1d:1a", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c114ae-43", "ovs_interfaceid": "e5c114ae-433c-4886-8a50-0c01256585af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:1d:1a,bridge_name='br-int',has_traffic_filtering=True,id=e5c114ae-433c-4886-8a50-0c01256585af,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c114ae-43') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:13:04 user nova-compute[70645]: DEBUG os_vif [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:1d:1a,bridge_name='br-int',has_traffic_filtering=True,id=e5c114ae-433c-4886-8a50-0c01256585af,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c114ae-43') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:13:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5c114ae-43, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:13:05 user nova-compute[70645]: INFO os_vif [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:1d:1a,bridge_name='br-int',has_traffic_filtering=True,id=e5c114ae-433c-4886-8a50-0c01256585af,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c114ae-43')
Jul 24 15:13:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Deleting instance files /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3_del
Jul 24 15:13:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Deletion of /opt/stack/data/nova/instances/271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3_del complete
Jul 24 15:13:05 user nova-compute[70645]: INFO nova.compute.manager [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 24 15:13:05 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:13:05 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:13:05 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:13:05 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:13:05 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Took 0.77 seconds to deallocate network for instance.
Jul 24 15:13:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-1611ec7c-2bfa-48a3-89f3-c2eb090915f7 req-aec1c8f2-bc0b-44fa-ad00-daa0163072dc service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-deleted-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:06 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:13:06 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:13:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:06 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Deleted allocations for instance 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3
Jul 24 15:13:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-267a8175-920f-4aa5-b5f6-278718f51d92 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.019s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-a70add10-fee5-477f-8d5d-f7c61fa9f378 req-c7570c50-edcc-433c-a8f7-6e53622180ca service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a70add10-fee5-477f-8d5d-f7c61fa9f378 req-c7570c50-edcc-433c-a8f7-6e53622180ca service nova] Acquiring lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a70add10-fee5-477f-8d5d-f7c61fa9f378 req-c7570c50-edcc-433c-a8f7-6e53622180ca service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a70add10-fee5-477f-8d5d-f7c61fa9f378 req-c7570c50-edcc-433c-a8f7-6e53622180ca service nova] Lock "271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-a70add10-fee5-477f-8d5d-f7c61fa9f378 req-c7570c50-edcc-433c-a8f7-6e53622180ca service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] No waiting events found dispatching network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:13:06 user nova-compute[70645]: WARNING nova.compute.manager [req-a70add10-fee5-477f-8d5d-f7c61fa9f378 req-c7570c50-edcc-433c-a8f7-6e53622180ca service nova] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Received unexpected event network-vif-plugged-e5c114ae-433c-4886-8a50-0c01256585af for instance with vm_state deleted and task_state None.
Jul 24 15:13:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:17 user nova-compute[70645]: INFO nova.compute.manager [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Unshelving
Jul 24 15:13:17 user nova-compute[70645]: INFO nova.virt.block_device [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Booting with volume d287b2a0-2700-4b84-8cc5-4ba3e83faffe at /dev/vda
Jul 24 15:13:17 user nova-compute[70645]: DEBUG os_brick.utils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d279dac3-c2a9-473b-bbf1-d492a7231825]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1e0c60-9304-4b0a-8584-94d3853140c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f46472-991b-474f-88cf-6ada41df87ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8ee304-8ac5-41bd-bac9-1a4787aa2d9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:13:17 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:13:17 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5711545c-e211-46e6-bdad-364d1e07e802]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG os_brick.utils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:13:17 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating existing volume attachment record: 9e8a49e8-77b4-4bbc-802e-2f07c78f3faf {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:13:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:19 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211584.977826, 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:13:19 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] VM Stopped (Lifecycle Event)
Jul 24 15:13:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8aef648a-1493-4082-b3a8-25c56e611baf None None] [instance: 271c8d9c-3af2-4c6b-bcbf-4c3fd3e566c3] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:25 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lazy-loading 'pci_requests' on Instance uuid 012bb476-47bc-4bfc-96aa-c53fe1d7de6e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:13:25 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lazy-loading 'numa_topology' on Instance uuid 012bb476-47bc-4bfc-96aa-c53fe1d7de6e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:13:25 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:13:25 user nova-compute[70645]: INFO nova.compute.claims [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Claim successful on node user
Jul 24 15:13:25 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:13:25 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:13:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:25 user nova-compute[70645]: INFO nova.network.neutron [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating port 33997fc3-0a55-4ace-8e42-d1d57ae5f66f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 24 15:13:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:13:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquired lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:13:26 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:13:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-6fe3e417-7742-42b7-8fe8-e46933b75d12 req-9d92f52c-50d4-4188-acc4-999490872e1a service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-changed-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-6fe3e417-7742-42b7-8fe8-e46933b75d12 req-9d92f52c-50d4-4188-acc4-999490872e1a service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Refreshing instance network info cache due to event network-changed-33997fc3-0a55-4ace-8e42-d1d57ae5f66f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:13:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6fe3e417-7742-42b7-8fe8-e46933b75d12 req-9d92f52c-50d4-4188-acc4-999490872e1a service nova] Acquiring lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating instance_info_cache with network_info: [{"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Releasing lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:13:27 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Creating image(s)
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Ensure instance console log exists: /opt/stack/data/nova/instances/012bb476-47bc-4bfc-96aa-c53fe1d7de6e/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Start _get_guest_xml network_info=[{"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9e8a49e8-77b4-4bbc-802e-2f07c78f3faf', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoxSDjbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '012bb476-47bc-4bfc-96aa-c53fe1d7de6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd287b2a0-2700-4b84-8cc5-4ba3e83faffe', 'serial': 'd287b2a0-2700-4b84-8cc5-4ba3e83faffe'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6fe3e417-7742-42b7-8fe8-e46933b75d12 req-9d92f52c-50d4-4188-acc4-999490872e1a service nova] Acquired lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.network.neutron [req-6fe3e417-7742-42b7-8fe8-e46933b75d12 req-9d92f52c-50d4-4188-acc4-999490872e1a service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Refreshing network info cache for port 33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:13:27 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:13:27 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lazy-loading 'vcpu_model' on Instance uuid 012bb476-47bc-4bfc-96aa-c53fe1d7de6e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoxSDjbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:13:27 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:13:27 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:13:27 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ed2135-cdd1-4cf6-b8ef-5e745046301d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:13:27 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d35a3-f0d4-4302-b2e6-3f5f16683497]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe] added
Jul 24 15:13:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[26decec4-655f-457a-a07f-4552c90056ad]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce292e01-40b8-4394-b2a7-230284ee2e71]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoxSDjbT {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoxSDjbT" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[de73d3b7-c812-4650-b074-77b5b9f3cebd]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FoxSDjbT'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e936a7-b33c-468d-9c19-39c9d753f28e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3bf57f-da25-49e9-a1a9-b6a7ad5a9712]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:13:27 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:13:27 user nova-compute[70645]:  {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:13:27 user nova-compute[70645]: WARNING os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 15:13:27 user nova-compute[70645]: 
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c39dfd9-db0b-4d9f-a953-d3ca0573fd49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260]
Jul 24 15:13:27 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260] successful.
Jul 24 15:13:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2528a032-00c4-490a-8970-ae41b02b557b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5025e2b0-d43e-45f9-bd02-a81bb2ed82c9]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:13:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:13:27 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3116f6-ab9d-4672-960e-279232b7b471]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoxSDjbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.network.neutron [req-6fe3e417-7742-42b7-8fe8-e46933b75d12 req-9d92f52c-50d4-4188-acc4-999490872e1a service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updated VIF entry in instance network info cache for port 33997fc3-0a55-4ace-8e42-d1d57ae5f66f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:13:27 user nova-compute[70645]: DEBUG nova.network.neutron [req-6fe3e417-7742-42b7-8fe8-e46933b75d12 req-9d92f52c-50d4-4188-acc4-999490872e1a service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating instance_info_cache with network_info: [{"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6fe3e417-7742-42b7-8fe8-e46933b75d12 req-9d92f52c-50d4-4188-acc4-999490872e1a service nova] Releasing lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26466366432346564', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466366432346564', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T15:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1065436731',display_name='tempest-TestShelveInstance-server-1065436731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1065436731',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1650283485',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:09:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2680ac44b8394d5c8e1b086884cb61f1',ramdisk_id='',reservation_id='r-j0ksgdvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2062206678',owner_user_name='tempest-TestShelveInstance-2062206678-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:13:18Z,user_data=None,user_id='6a73120d16244c85b13ec468bca3c982',uuid=012bb476-47bc-4bfc-96aa-c53fe1d7de6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converting VIF {"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lazy-loading 'pci_devices' on Instance uuid 012bb476-47bc-4bfc-96aa-c53fe1d7de6e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:13:28 user nova-compute[70645]:   <uuid>012bb476-47bc-4bfc-96aa-c53fe1d7de6e</uuid>
Jul 24 15:13:28 user nova-compute[70645]:   <name>instance-00000023</name>
Jul 24 15:13:28 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:13:28 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:13:28 user nova-compute[70645]:   <metadata>
Jul 24 15:13:28 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:13:28 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:13:28 user nova-compute[70645]:       <nova:name>tempest-TestShelveInstance-server-1065436731</nova:name>
Jul 24 15:13:28 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:13:27</nova:creationTime>
Jul 24 15:13:28 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:13:28 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:13:28 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:13:28 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:13:28 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:13:28 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:13:28 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:13:28 user nova-compute[70645]:       <nova:owner>
Jul 24 15:13:28 user nova-compute[70645]:         <nova:user uuid="6a73120d16244c85b13ec468bca3c982">tempest-TestShelveInstance-2062206678-project-member</nova:user>
Jul 24 15:13:28 user nova-compute[70645]:         <nova:project uuid="2680ac44b8394d5c8e1b086884cb61f1">tempest-TestShelveInstance-2062206678</nova:project>
Jul 24 15:13:28 user nova-compute[70645]:       </nova:owner>
Jul 24 15:13:28 user nova-compute[70645]:       <nova:ports>
Jul 24 15:13:28 user nova-compute[70645]:         <nova:port uuid="33997fc3-0a55-4ace-8e42-d1d57ae5f66f">
Jul 24 15:13:28 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 15:13:28 user nova-compute[70645]:         </nova:port>
Jul 24 15:13:28 user nova-compute[70645]:       </nova:ports>
Jul 24 15:13:28 user nova-compute[70645]:     </nova:instance>
Jul 24 15:13:28 user nova-compute[70645]:   </metadata>
Jul 24 15:13:28 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:13:28 user nova-compute[70645]:     <system>
Jul 24 15:13:28 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:13:28 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:13:28 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:13:28 user nova-compute[70645]:       <entry name="serial">012bb476-47bc-4bfc-96aa-c53fe1d7de6e</entry>
Jul 24 15:13:28 user nova-compute[70645]:       <entry name="uuid">012bb476-47bc-4bfc-96aa-c53fe1d7de6e</entry>
Jul 24 15:13:28 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:13:28 user nova-compute[70645]:     </system>
Jul 24 15:13:28 user nova-compute[70645]:   </sysinfo>
Jul 24 15:13:28 user nova-compute[70645]:   <os>
Jul 24 15:13:28 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:13:28 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:13:28 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:13:28 user nova-compute[70645]:   </os>
Jul 24 15:13:28 user nova-compute[70645]:   <features>
Jul 24 15:13:28 user nova-compute[70645]:     <acpi/>
Jul 24 15:13:28 user nova-compute[70645]:     <apic/>
Jul 24 15:13:28 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:13:28 user nova-compute[70645]:   </features>
Jul 24 15:13:28 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:13:28 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:13:28 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:13:28 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:13:28 user nova-compute[70645]:   </clock>
Jul 24 15:13:28 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:13:28 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:13:28 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:13:28 user nova-compute[70645]:   </cpu>
Jul 24 15:13:28 user nova-compute[70645]:   <devices>
Jul 24 15:13:28 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:13:28 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:13:28 user nova-compute[70645]:       <source dev="/dev/sdb"/>
Jul 24 15:13:28 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:13:28 user nova-compute[70645]:       <serial>d287b2a0-2700-4b84-8cc5-4ba3e83faffe</serial>
Jul 24 15:13:28 user nova-compute[70645]:     </disk>
Jul 24 15:13:28 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:13:28 user nova-compute[70645]:       <mac address="fa:16:3e:c6:84:18"/>
Jul 24 15:13:28 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:13:28 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:13:28 user nova-compute[70645]:       <target dev="tap33997fc3-0a"/>
Jul 24 15:13:28 user nova-compute[70645]:     </interface>
Jul 24 15:13:28 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:13:28 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/012bb476-47bc-4bfc-96aa-c53fe1d7de6e/console.log" append="off"/>
Jul 24 15:13:28 user nova-compute[70645]:     </serial>
Jul 24 15:13:28 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:13:28 user nova-compute[70645]:     <video>
Jul 24 15:13:28 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:13:28 user nova-compute[70645]:     </video>
Jul 24 15:13:28 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:13:28 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:13:28 user nova-compute[70645]:     </rng>
Jul 24 15:13:28 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:13:28 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:13:28 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:13:28 user nova-compute[70645]:     </memballoon>
Jul 24 15:13:28 user nova-compute[70645]:   </devices>
Jul 24 15:13:28 user nova-compute[70645]: </domain>
Jul 24 15:13:28 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T15:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1065436731',display_name='tempest-TestShelveInstance-server-1065436731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1065436731',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1650283485',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:09:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2680ac44b8394d5c8e1b086884cb61f1',ramdisk_id='',reservation_id='r-j0ksgdvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2062206678',owner_user_name='tempest-TestShelveInstance-2062206678-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:13:18Z,user_data=None,user_id='6a73120d16244c85b13ec468bca3c982',uuid=012bb476-47bc-4bfc-96aa-c53fe1d7de6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converting VIF {"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG os_vif [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33997fc3-0a, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33997fc3-0a, col_values=(('external_ids', {'iface-id': '33997fc3-0a55-4ace-8e42-d1d57ae5f66f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:84:18', 'vm-uuid': '012bb476-47bc-4bfc-96aa-c53fe1d7de6e'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:29 user nova-compute[70645]: INFO os_vif [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a')
Jul 24 15:13:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] No VIF found with MAC fa:16:3e:c6:84:18, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:13:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:30 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-43ebb6e3-3c95-4867-a292-4a76b6ab3005 req-66a259a7-37f4-446a-82fd-db8d55a709a3 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-43ebb6e3-3c95-4867-a292-4a76b6ab3005 req-66a259a7-37f4-446a-82fd-db8d55a709a3 service nova] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-43ebb6e3-3c95-4867-a292-4a76b6ab3005 req-66a259a7-37f4-446a-82fd-db8d55a709a3 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-43ebb6e3-3c95-4867-a292-4a76b6ab3005 req-66a259a7-37f4-446a-82fd-db8d55a709a3 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-43ebb6e3-3c95-4867-a292-4a76b6ab3005 req-66a259a7-37f4-446a-82fd-db8d55a709a3 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] No waiting events found dispatching network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:13:31 user nova-compute[70645]: WARNING nova.compute.manager [req-43ebb6e3-3c95-4867-a292-4a76b6ab3005 req-66a259a7-37f4-446a-82fd-db8d55a709a3 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received unexpected event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 15:13:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:31 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:13:31 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:13:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8416MB free_disk=25.46627426147461GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance cf8bcde0-6825-45f0-85c3-14188211558c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (a0cf5b80-69d2-4191-894e-a498eab7d688): {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. Skipping heal of allocations during the task state transition. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:13:31 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:13:32 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:13:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:13:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:13:32 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211612.5854766, 012bb476-47bc-4bfc-96aa-c53fe1d7de6e => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:13:32 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] VM Resumed (Lifecycle Event)
Jul 24 15:13:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Instance spawned successfully.
Jul 24 15:13:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:13:32 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:13:32 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211612.5860927, 012bb476-47bc-4bfc-96aa-c53fe1d7de6e => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:13:32 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] VM Started (Lifecycle Event)
Jul 24 15:13:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:13:32 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:13:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7c0153d1-89a7-4ec9-adcf-2f203e561921 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.144s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-b25ac547-a72c-45b1-8bf2-3c5a8d14c8b3 req-43b17eb0-0070-44c9-af0c-e47d330672e3 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b25ac547-a72c-45b1-8bf2-3c5a8d14c8b3 req-43b17eb0-0070-44c9-af0c-e47d330672e3 service nova] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b25ac547-a72c-45b1-8bf2-3c5a8d14c8b3 req-43b17eb0-0070-44c9-af0c-e47d330672e3 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b25ac547-a72c-45b1-8bf2-3c5a8d14c8b3 req-43b17eb0-0070-44c9-af0c-e47d330672e3 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-b25ac547-a72c-45b1-8bf2-3c5a8d14c8b3 req-43b17eb0-0070-44c9-af0c-e47d330672e3 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] No waiting events found dispatching network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:13:33 user nova-compute[70645]: WARNING nova.compute.manager [req-b25ac547-a72c-45b1-8bf2-3c5a8d14c8b3 req-43b17eb0-0070-44c9-af0c-e47d330672e3 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received unexpected event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f for instance with vm_state active and task_state None.
Jul 24 15:13:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:13:34 user nova-compute[70645]: INFO nova.compute.claims [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Claim successful on node user
Jul 24 15:13:34 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 15:13:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] There are 0 instances to clean {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:13:35 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:13:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG nova.policy [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '782bcf41be0f4fcf881d467649ef5206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2699829f2bd4b638132ea38a8f28b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:13:35 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Creating image(s)
Jul 24 15:13:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "/opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "/opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "/opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "0ed7924833608b7b0fbf24aecb9febbf8c170afb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "0ed7924833608b7b0fbf24aecb9febbf8c170afb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb.part --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:36 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Successfully created port: 4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:13:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb.part --force-share --output=json" returned: 0 in 0.169s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:36 user nova-compute[70645]: DEBUG nova.virt.images [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] 3135bff3-0df2-4a5e-ab94-eb5dd2f182b2 was qcow2, converting to raw {{(pid=70645) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 15:13:36 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 15:13:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb.part /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb.converted {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb.part /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb.converted" returned: 0 in 0.348s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb.converted --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "0ed7924833608b7b0fbf24aecb9febbf8c170afb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.444s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb --force-share --output=json" returned: 0 in 0.170s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "0ed7924833608b7b0fbf24aecb9febbf8c170afb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "0ed7924833608b7b0fbf24aecb9febbf8c170afb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb --force-share --output=json" returned: 0 in 0.173s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb,backing_fmt=raw /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb,backing_fmt=raw /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk 1073741824" returned: 0 in 0.071s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "0ed7924833608b7b0fbf24aecb9febbf8c170afb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Successfully updated port: 4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-9f79a683-fa6b-4630-a2eb-f501db86bb65 req-3d021f4f-c3f0-44cd-8ecc-4b883066970a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-changed-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-9f79a683-fa6b-4630-a2eb-f501db86bb65 req-3d021f4f-c3f0-44cd-8ecc-4b883066970a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Refreshing instance network info cache due to event network-changed-4dee8450-99dd-4a74-b710-6760a5a94e79. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9f79a683-fa6b-4630-a2eb-f501db86bb65 req-3d021f4f-c3f0-44cd-8ecc-4b883066970a service nova] Acquiring lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9f79a683-fa6b-4630-a2eb-f501db86bb65 req-3d021f4f-c3f0-44cd-8ecc-4b883066970a service nova] Acquired lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-9f79a683-fa6b-4630-a2eb-f501db86bb65 req-3d021f4f-c3f0-44cd-8ecc-4b883066970a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Refreshing network info cache for port 4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-9f79a683-fa6b-4630-a2eb-f501db86bb65 req-3d021f4f-c3f0-44cd-8ecc-4b883066970a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb --force-share --output=json" returned: 0 in 0.172s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:13:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Cannot resize image /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'migration_context' on Instance uuid 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Ensure instance console log exists: /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.network.neutron [req-9f79a683-fa6b-4630-a2eb-f501db86bb65 req-3d021f4f-c3f0-44cd-8ecc-4b883066970a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9f79a683-fa6b-4630-a2eb-f501db86bb65 req-3d021f4f-c3f0-44cd-8ecc-4b883066970a service nova] Releasing lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquired lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.network.neutron [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updating instance_info_cache with network_info: [{"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Releasing lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Instance network_info: |[{"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Start _get_guest_xml network_info=[{"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T15:13:31Z,direct_url=<?>,disk_format='qcow2',id=3135bff3-0df2-4a5e-ab94-eb5dd2f182b2,min_disk=0,min_ram=0,name='tempest-scenario-img--350830339',owner='b2699829f2bd4b638132ea38a8f28b13',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T15:13:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': '3135bff3-0df2-4a5e-ab94-eb5dd2f182b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:13:38 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:13:38 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T15:13:31Z,direct_url=<?>,disk_format='qcow2',id=3135bff3-0df2-4a5e-ab94-eb5dd2f182b2,min_disk=0,min_ram=0,name='tempest-scenario-img--350830339',owner='b2699829f2bd4b638132ea38a8f28b13',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T15:13:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-424672047',display_name='tempest-TestMinimumBasicScenario-server-424672047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-424672047',id=36,image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMCo6QZiJchQhXRrPHIyCnOnnbjhZeUgUNG+32wdjxCdvlCaRVoEBgBdjGF7809Qm8W4trKXOzuU4MYrdfJ22pUeuIEmUyKnM5PXOk3q1rOao/NPluVjCFlULEzSwPC6Q==',key_name='tempest-TestMinimumBasicScenario-976160831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2699829f2bd4b638132ea38a8f28b13',ramdisk_id='',reservation_id='r-81kts241',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-55837010',owner_user_name='tempest-TestMinimumBasicScenario-55837010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:13:36Z,user_data=None,user_id='782bcf41be0f4fcf881d467649ef5206',uuid=1372f999-32a0-4079-ab57-597093017d8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converting VIF {"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'pci_devices' on Instance uuid 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:13:38 user nova-compute[70645]:   <uuid>1372f999-32a0-4079-ab57-597093017d8b</uuid>
Jul 24 15:13:38 user nova-compute[70645]:   <name>instance-00000024</name>
Jul 24 15:13:38 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:13:38 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:13:38 user nova-compute[70645]:   <metadata>
Jul 24 15:13:38 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:13:38 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:13:38 user nova-compute[70645]:       <nova:name>tempest-TestMinimumBasicScenario-server-424672047</nova:name>
Jul 24 15:13:38 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:13:38</nova:creationTime>
Jul 24 15:13:38 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:13:38 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:13:38 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:13:38 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:13:38 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:13:38 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:13:38 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:13:38 user nova-compute[70645]:       <nova:owner>
Jul 24 15:13:38 user nova-compute[70645]:         <nova:user uuid="782bcf41be0f4fcf881d467649ef5206">tempest-TestMinimumBasicScenario-55837010-project-member</nova:user>
Jul 24 15:13:38 user nova-compute[70645]:         <nova:project uuid="b2699829f2bd4b638132ea38a8f28b13">tempest-TestMinimumBasicScenario-55837010</nova:project>
Jul 24 15:13:38 user nova-compute[70645]:       </nova:owner>
Jul 24 15:13:38 user nova-compute[70645]:       <nova:root type="image" uuid="3135bff3-0df2-4a5e-ab94-eb5dd2f182b2"/>
Jul 24 15:13:38 user nova-compute[70645]:       <nova:ports>
Jul 24 15:13:38 user nova-compute[70645]:         <nova:port uuid="4dee8450-99dd-4a74-b710-6760a5a94e79">
Jul 24 15:13:38 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 15:13:38 user nova-compute[70645]:         </nova:port>
Jul 24 15:13:38 user nova-compute[70645]:       </nova:ports>
Jul 24 15:13:38 user nova-compute[70645]:     </nova:instance>
Jul 24 15:13:38 user nova-compute[70645]:   </metadata>
Jul 24 15:13:38 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:13:38 user nova-compute[70645]:     <system>
Jul 24 15:13:38 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:13:38 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:13:38 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:13:38 user nova-compute[70645]:       <entry name="serial">1372f999-32a0-4079-ab57-597093017d8b</entry>
Jul 24 15:13:38 user nova-compute[70645]:       <entry name="uuid">1372f999-32a0-4079-ab57-597093017d8b</entry>
Jul 24 15:13:38 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:13:38 user nova-compute[70645]:     </system>
Jul 24 15:13:38 user nova-compute[70645]:   </sysinfo>
Jul 24 15:13:38 user nova-compute[70645]:   <os>
Jul 24 15:13:38 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:13:38 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:13:38 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:13:38 user nova-compute[70645]:   </os>
Jul 24 15:13:38 user nova-compute[70645]:   <features>
Jul 24 15:13:38 user nova-compute[70645]:     <acpi/>
Jul 24 15:13:38 user nova-compute[70645]:     <apic/>
Jul 24 15:13:38 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:13:38 user nova-compute[70645]:   </features>
Jul 24 15:13:38 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:13:38 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:13:38 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:13:38 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:13:38 user nova-compute[70645]:   </clock>
Jul 24 15:13:38 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:13:38 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:13:38 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:13:38 user nova-compute[70645]:   </cpu>
Jul 24 15:13:38 user nova-compute[70645]:   <devices>
Jul 24 15:13:38 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:13:38 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:13:38 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk"/>
Jul 24 15:13:38 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:13:38 user nova-compute[70645]:     </disk>
Jul 24 15:13:38 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:13:38 user nova-compute[70645]:       <mac address="fa:16:3e:ce:ee:14"/>
Jul 24 15:13:38 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:13:38 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:13:38 user nova-compute[70645]:       <target dev="tap4dee8450-99"/>
Jul 24 15:13:38 user nova-compute[70645]:     </interface>
Jul 24 15:13:38 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:13:38 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/console.log" append="off"/>
Jul 24 15:13:38 user nova-compute[70645]:     </serial>
Jul 24 15:13:38 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:13:38 user nova-compute[70645]:     <video>
Jul 24 15:13:38 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:13:38 user nova-compute[70645]:     </video>
Jul 24 15:13:38 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:13:38 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:13:38 user nova-compute[70645]:     </rng>
Jul 24 15:13:38 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:13:38 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:13:38 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:13:38 user nova-compute[70645]:     </memballoon>
Jul 24 15:13:38 user nova-compute[70645]:   </devices>
Jul 24 15:13:38 user nova-compute[70645]: </domain>
Jul 24 15:13:38 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-424672047',display_name='tempest-TestMinimumBasicScenario-server-424672047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-424672047',id=36,image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMCo6QZiJchQhXRrPHIyCnOnnbjhZeUgUNG+32wdjxCdvlCaRVoEBgBdjGF7809Qm8W4trKXOzuU4MYrdfJ22pUeuIEmUyKnM5PXOk3q1rOao/NPluVjCFlULEzSwPC6Q==',key_name='tempest-TestMinimumBasicScenario-976160831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2699829f2bd4b638132ea38a8f28b13',ramdisk_id='',reservation_id='r-81kts241',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-55837010',owner_user_name='tempest-TestMinimumBasicScenario-55837010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:13:36Z,user_data=None,user_id='782bcf41be0f4fcf881d467649ef5206',uuid=1372f999-32a0-4079-ab57-597093017d8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converting VIF {"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG os_vif [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dee8450-99, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4dee8450-99, col_values=(('external_ids', {'iface-id': '4dee8450-99dd-4a74-b710-6760a5a94e79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ee:14', 'vm-uuid': '1372f999-32a0-4079-ab57-597093017d8b'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:38 user nova-compute[70645]: INFO os_vif [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99')
Jul 24 15:13:38 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:13:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] No VIF found with MAC fa:16:3e:ce:ee:14, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:13:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:40 user nova-compute[70645]: DEBUG nova.compute.manager [req-e8c7869c-caea-4e02-ab2e-8a0b3e3b8131 req-2b8e57d5-fbe2-487b-93ef-2ad166e62365 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e8c7869c-caea-4e02-ab2e-8a0b3e3b8131 req-2b8e57d5-fbe2-487b-93ef-2ad166e62365 service nova] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e8c7869c-caea-4e02-ab2e-8a0b3e3b8131 req-2b8e57d5-fbe2-487b-93ef-2ad166e62365 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e8c7869c-caea-4e02-ab2e-8a0b3e3b8131 req-2b8e57d5-fbe2-487b-93ef-2ad166e62365 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:40 user nova-compute[70645]: DEBUG nova.compute.manager [req-e8c7869c-caea-4e02-ab2e-8a0b3e3b8131 req-2b8e57d5-fbe2-487b-93ef-2ad166e62365 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] No waiting events found dispatching network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:13:40 user nova-compute[70645]: WARNING nova.compute.manager [req-e8c7869c-caea-4e02-ab2e-8a0b3e3b8131 req-2b8e57d5-fbe2-487b-93ef-2ad166e62365 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received unexpected event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 for instance with vm_state building and task_state spawning.
Jul 24 15:13:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211622.6205716, 1372f999-32a0-4079-ab57-597093017d8b => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:13:42 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] VM Resumed (Lifecycle Event)
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:13:42 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Instance spawned successfully.
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:42 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211622.6264033, 1372f999-32a0-4079-ab57-597093017d8b => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:13:42 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] VM Started (Lifecycle Event)
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:13:42 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.compute.manager [req-39b752e9-4651-425e-9f9b-1cc2c0ccc11f req-e88f0eae-fbde-4d24-afa9-ca9dba68fc20 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-39b752e9-4651-425e-9f9b-1cc2c0ccc11f req-e88f0eae-fbde-4d24-afa9-ca9dba68fc20 service nova] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-39b752e9-4651-425e-9f9b-1cc2c0ccc11f req-e88f0eae-fbde-4d24-afa9-ca9dba68fc20 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-39b752e9-4651-425e-9f9b-1cc2c0ccc11f req-e88f0eae-fbde-4d24-afa9-ca9dba68fc20 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.compute.manager [req-39b752e9-4651-425e-9f9b-1cc2c0ccc11f req-e88f0eae-fbde-4d24-afa9-ca9dba68fc20 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] No waiting events found dispatching network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:13:42 user nova-compute[70645]: WARNING nova.compute.manager [req-39b752e9-4651-425e-9f9b-1cc2c0ccc11f req-e88f0eae-fbde-4d24-afa9-ca9dba68fc20 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received unexpected event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 for instance with vm_state building and task_state spawning.
Jul 24 15:13:42 user nova-compute[70645]: INFO nova.compute.manager [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Took 6.88 seconds to spawn the instance on the hypervisor.
Jul 24 15:13:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:42 user nova-compute[70645]: INFO nova.compute.manager [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Took 8.06 seconds to build instance.
Jul 24 15:13:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e8bf1a2-f4b5-4bde-9669-286db1e0bd8c tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.248s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "47016839-ba35-418a-af61-d2b9ed1ffccc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:13:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:45 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:13:45 user nova-compute[70645]: INFO nova.compute.claims [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Claim successful on node user
Jul 24 15:13:45 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:13:45 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:13:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:13:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:13:45 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:13:45 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:13:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG nova.policy [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00e9c5d73ac941ed8b67471058c3db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d61e837ad1e437fb8b9ebee58a2e228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:13:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Creating image(s)
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "/opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "/opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "/opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk 1073741824" returned: 0 in 0.057s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.173s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Cannot resize image /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG nova.objects.instance [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'migration_context' on Instance uuid 47016839-ba35-418a-af61-d2b9ed1ffccc {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Ensure instance console log exists: /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:47 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70645) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 15:13:47 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:13:47 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Successfully created port: 5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:13:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:48 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Successfully updated port: 5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:13:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:13:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquired lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:13:48 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:13:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-fc927fef-62b2-4c39-b796-0cd6fe370cd3 req-933c6ef5-fe3b-4149-ae96-e242fbd88fba service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received event network-changed-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-fc927fef-62b2-4c39-b796-0cd6fe370cd3 req-933c6ef5-fe3b-4149-ae96-e242fbd88fba service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Refreshing instance network info cache due to event network-changed-5987a4b3-b4ae-472d-b509-1f527b9c64e7. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:13:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fc927fef-62b2-4c39-b796-0cd6fe370cd3 req-933c6ef5-fe3b-4149-ae96-e242fbd88fba service nova] Acquiring lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:13:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:48 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.network.neutron [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updating instance_info_cache with network_info: [{"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "936cb284-e0df-4640-ad6a-9719d334a26c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Releasing lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Instance network_info: |[{"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fc927fef-62b2-4c39-b796-0cd6fe370cd3 req-933c6ef5-fe3b-4149-ae96-e242fbd88fba service nova] Acquired lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-fc927fef-62b2-4c39-b796-0cd6fe370cd3 req-933c6ef5-fe3b-4149-ae96-e242fbd88fba service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Refreshing network info cache for port 5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Start _get_guest_xml network_info=[{"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:13:49 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:13:49 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-444649864',display_name='tempest-TestStampPattern-server-444649864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-444649864',id=37,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpaiR09gawF0BiABPWc5BhN+ZqJhKaACzOhcrf2boJj0UiD0Yx//+fQ+eBUaDKWD1VfnztdaIfJWCRQbiO7xZZ9eT9akk4tzJdcm5XEY3bK9HSekgcRSxxbsyrKUsbDHw==',key_name='tempest-TestStampPattern-922639899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d61e837ad1e437fb8b9ebee58a2e228',ramdisk_id='',reservation_id='r-u1340747',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-63827052',owner_user_name='tempest-TestStampPattern-63827052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:13:46Z,user_data=None,user_id='00e9c5d73ac941ed8b67471058c3db0a',uuid=47016839-ba35-418a-af61-d2b9ed1ffccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converting VIF {"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c5:ee,bridge_name='br-int',has_traffic_filtering=True,id=5987a4b3-b4ae-472d-b509-1f527b9c64e7,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987a4b3-b4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.objects.instance [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'pci_devices' on Instance uuid 47016839-ba35-418a-af61-d2b9ed1ffccc {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:13:49 user nova-compute[70645]:   <uuid>47016839-ba35-418a-af61-d2b9ed1ffccc</uuid>
Jul 24 15:13:49 user nova-compute[70645]:   <name>instance-00000025</name>
Jul 24 15:13:49 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:13:49 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:13:49 user nova-compute[70645]:   <metadata>
Jul 24 15:13:49 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:13:49 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:13:49 user nova-compute[70645]:       <nova:name>tempest-TestStampPattern-server-444649864</nova:name>
Jul 24 15:13:49 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:13:49</nova:creationTime>
Jul 24 15:13:49 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:13:49 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:13:49 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:13:49 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:13:49 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:13:49 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:13:49 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:13:49 user nova-compute[70645]:       <nova:owner>
Jul 24 15:13:49 user nova-compute[70645]:         <nova:user uuid="00e9c5d73ac941ed8b67471058c3db0a">tempest-TestStampPattern-63827052-project-member</nova:user>
Jul 24 15:13:49 user nova-compute[70645]:         <nova:project uuid="2d61e837ad1e437fb8b9ebee58a2e228">tempest-TestStampPattern-63827052</nova:project>
Jul 24 15:13:49 user nova-compute[70645]:       </nova:owner>
Jul 24 15:13:49 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:13:49 user nova-compute[70645]:       <nova:ports>
Jul 24 15:13:49 user nova-compute[70645]:         <nova:port uuid="5987a4b3-b4ae-472d-b509-1f527b9c64e7">
Jul 24 15:13:49 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 24 15:13:49 user nova-compute[70645]:         </nova:port>
Jul 24 15:13:49 user nova-compute[70645]:       </nova:ports>
Jul 24 15:13:49 user nova-compute[70645]:     </nova:instance>
Jul 24 15:13:49 user nova-compute[70645]:   </metadata>
Jul 24 15:13:49 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:13:49 user nova-compute[70645]:     <system>
Jul 24 15:13:49 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:13:49 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:13:49 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:13:49 user nova-compute[70645]:       <entry name="serial">47016839-ba35-418a-af61-d2b9ed1ffccc</entry>
Jul 24 15:13:49 user nova-compute[70645]:       <entry name="uuid">47016839-ba35-418a-af61-d2b9ed1ffccc</entry>
Jul 24 15:13:49 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:13:49 user nova-compute[70645]:     </system>
Jul 24 15:13:49 user nova-compute[70645]:   </sysinfo>
Jul 24 15:13:49 user nova-compute[70645]:   <os>
Jul 24 15:13:49 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:13:49 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:13:49 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:13:49 user nova-compute[70645]:   </os>
Jul 24 15:13:49 user nova-compute[70645]:   <features>
Jul 24 15:13:49 user nova-compute[70645]:     <acpi/>
Jul 24 15:13:49 user nova-compute[70645]:     <apic/>
Jul 24 15:13:49 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:13:49 user nova-compute[70645]:   </features>
Jul 24 15:13:49 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:13:49 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:13:49 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:13:49 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:13:49 user nova-compute[70645]:   </clock>
Jul 24 15:13:49 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:13:49 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:13:49 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:13:49 user nova-compute[70645]:   </cpu>
Jul 24 15:13:49 user nova-compute[70645]:   <devices>
Jul 24 15:13:49 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:13:49 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:13:49 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk"/>
Jul 24 15:13:49 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:13:49 user nova-compute[70645]:     </disk>
Jul 24 15:13:49 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:13:49 user nova-compute[70645]:       <mac address="fa:16:3e:7c:c5:ee"/>
Jul 24 15:13:49 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:13:49 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:13:49 user nova-compute[70645]:       <target dev="tap5987a4b3-b4"/>
Jul 24 15:13:49 user nova-compute[70645]:     </interface>
Jul 24 15:13:49 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:13:49 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/console.log" append="off"/>
Jul 24 15:13:49 user nova-compute[70645]:     </serial>
Jul 24 15:13:49 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:13:49 user nova-compute[70645]:     <video>
Jul 24 15:13:49 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:13:49 user nova-compute[70645]:     </video>
Jul 24 15:13:49 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:13:49 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:13:49 user nova-compute[70645]:     </rng>
Jul 24 15:13:49 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:13:49 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:13:49 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:13:49 user nova-compute[70645]:     </memballoon>
Jul 24 15:13:49 user nova-compute[70645]:   </devices>
Jul 24 15:13:49 user nova-compute[70645]: </domain>
Jul 24 15:13:49 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-444649864',display_name='tempest-TestStampPattern-server-444649864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-444649864',id=37,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpaiR09gawF0BiABPWc5BhN+ZqJhKaACzOhcrf2boJj0UiD0Yx//+fQ+eBUaDKWD1VfnztdaIfJWCRQbiO7xZZ9eT9akk4tzJdcm5XEY3bK9HSekgcRSxxbsyrKUsbDHw==',key_name='tempest-TestStampPattern-922639899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d61e837ad1e437fb8b9ebee58a2e228',ramdisk_id='',reservation_id='r-u1340747',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-63827052',owner_user_name='tempest-TestStampPattern-63827052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:13:46Z,user_data=None,user_id='00e9c5d73ac941ed8b67471058c3db0a',uuid=47016839-ba35-418a-af61-d2b9ed1ffccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converting VIF {"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c5:ee,bridge_name='br-int',has_traffic_filtering=True,id=5987a4b3-b4ae-472d-b509-1f527b9c64e7,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987a4b3-b4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG os_vif [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c5:ee,bridge_name='br-int',has_traffic_filtering=True,id=5987a4b3-b4ae-472d-b509-1f527b9c64e7,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987a4b3-b4') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5987a4b3-b4, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5987a4b3-b4, col_values=(('external_ids', {'iface-id': '5987a4b3-b4ae-472d-b509-1f527b9c64e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:c5:ee', 'vm-uuid': '47016839-ba35-418a-af61-d2b9ed1ffccc'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:49 user nova-compute[70645]: INFO os_vif [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c5:ee,bridge_name='br-int',has_traffic_filtering=True,id=5987a4b3-b4ae-472d-b509-1f527b9c64e7,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987a4b3-b4')
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:13:49 user nova-compute[70645]: INFO nova.compute.claims [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Claim successful on node user
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] No VIF found with MAC fa:16:3e:7c:c5:ee, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-fc927fef-62b2-4c39-b796-0cd6fe370cd3 req-933c6ef5-fe3b-4149-ae96-e242fbd88fba service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updated VIF entry in instance network info cache for port 5987a4b3-b4ae-472d-b509-1f527b9c64e7. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-fc927fef-62b2-4c39-b796-0cd6fe370cd3 req-933c6ef5-fe3b-4149-ae96-e242fbd88fba service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updating instance_info_cache with network_info: [{"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fc927fef-62b2-4c39-b796-0cd6fe370cd3 req-933c6ef5-fe3b-4149-ae96-e242fbd88fba service nova] Releasing lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:13:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:13:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG nova.policy [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07525ed635a7407495f38c9556e7ce59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7f4608ea8242fcbacfba6754da3628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:13:50 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Creating image(s)
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "/opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "/opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "/opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.175s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.169s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk 1073741824" returned: 0 in 0.075s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Cannot resize image /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG nova.objects.instance [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'migration_context' on Instance uuid 936cb284-e0df-4640-ad6a-9719d334a26c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Ensure instance console log exists: /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:51 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Successfully created port: b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:13:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-5077b1e4-55f8-44da-bc6c-9e1d62e1290d req-74fba68a-a662-4561-81a3-80620420f9aa service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received event network-vif-plugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5077b1e4-55f8-44da-bc6c-9e1d62e1290d req-74fba68a-a662-4561-81a3-80620420f9aa service nova] Acquiring lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5077b1e4-55f8-44da-bc6c-9e1d62e1290d req-74fba68a-a662-4561-81a3-80620420f9aa service nova] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5077b1e4-55f8-44da-bc6c-9e1d62e1290d req-74fba68a-a662-4561-81a3-80620420f9aa service nova] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-5077b1e4-55f8-44da-bc6c-9e1d62e1290d req-74fba68a-a662-4561-81a3-80620420f9aa service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] No waiting events found dispatching network-vif-plugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:13:51 user nova-compute[70645]: WARNING nova.compute.manager [req-5077b1e4-55f8-44da-bc6c-9e1d62e1290d req-74fba68a-a662-4561-81a3-80620420f9aa service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received unexpected event network-vif-plugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 for instance with vm_state building and task_state spawning.
Jul 24 15:13:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Successfully updated port: b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquired lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-fcbaa4a1-6bd3-407c-9e5c-469a7283ba1e req-c4b745c7-55c7-47e6-8432-43087123f84e service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Received event network-changed-b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-fcbaa4a1-6bd3-407c-9e5c-469a7283ba1e req-c4b745c7-55c7-47e6-8432-43087123f84e service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Refreshing instance network info cache due to event network-changed-b3256b72-7d12-4211-af7c-8c3309af4b3b. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fcbaa4a1-6bd3-407c-9e5c-469a7283ba1e req-c4b745c7-55c7-47e6-8432-43087123f84e service nova] Acquiring lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Updating instance_info_cache with network_info: [{"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Releasing lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Instance network_info: |[{"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fcbaa4a1-6bd3-407c-9e5c-469a7283ba1e req-c4b745c7-55c7-47e6-8432-43087123f84e service nova] Acquired lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-fcbaa4a1-6bd3-407c-9e5c-469a7283ba1e req-c4b745c7-55c7-47e6-8432-43087123f84e service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Refreshing network info cache for port b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Start _get_guest_xml network_info=[{"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:13:52 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:13:52 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1039009520',display_name='tempest-AttachVolumeNegativeTest-server-1039009520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1039009520',id=38,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh/JZ3YxLZ5fvpdm1Uo19kj4TE2PMVgkdngKCZzySwQKZ9gkap4gWcTWkpN8EhS29LH18A/u4J+mheHTw1k7ZsT0Yb38KaRqxcu65QlRIw2hVrsPSEz9re174lxKV0Aqg==',key_name='tempest-keypair-405716000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-0i0krm5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:13:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=936cb284-e0df-4640-ad6a-9719d334a26c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=b3256b72-7d12-4211-af7c-8c3309af4b3b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3256b72-7d') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.objects.instance [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'pci_devices' on Instance uuid 936cb284-e0df-4640-ad6a-9719d334a26c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:13:52 user nova-compute[70645]:   <uuid>936cb284-e0df-4640-ad6a-9719d334a26c</uuid>
Jul 24 15:13:52 user nova-compute[70645]:   <name>instance-00000026</name>
Jul 24 15:13:52 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:13:52 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:13:52 user nova-compute[70645]:   <metadata>
Jul 24 15:13:52 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:13:52 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:13:52 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1039009520</nova:name>
Jul 24 15:13:52 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:13:52</nova:creationTime>
Jul 24 15:13:52 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:13:52 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:13:52 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:13:52 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:13:52 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:13:52 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:13:52 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:13:52 user nova-compute[70645]:       <nova:owner>
Jul 24 15:13:52 user nova-compute[70645]:         <nova:user uuid="07525ed635a7407495f38c9556e7ce59">tempest-AttachVolumeNegativeTest-508353659-project-member</nova:user>
Jul 24 15:13:52 user nova-compute[70645]:         <nova:project uuid="de7f4608ea8242fcbacfba6754da3628">tempest-AttachVolumeNegativeTest-508353659</nova:project>
Jul 24 15:13:52 user nova-compute[70645]:       </nova:owner>
Jul 24 15:13:52 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:13:52 user nova-compute[70645]:       <nova:ports>
Jul 24 15:13:52 user nova-compute[70645]:         <nova:port uuid="b3256b72-7d12-4211-af7c-8c3309af4b3b">
Jul 24 15:13:52 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 15:13:52 user nova-compute[70645]:         </nova:port>
Jul 24 15:13:52 user nova-compute[70645]:       </nova:ports>
Jul 24 15:13:52 user nova-compute[70645]:     </nova:instance>
Jul 24 15:13:52 user nova-compute[70645]:   </metadata>
Jul 24 15:13:52 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:13:52 user nova-compute[70645]:     <system>
Jul 24 15:13:52 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:13:52 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:13:52 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:13:52 user nova-compute[70645]:       <entry name="serial">936cb284-e0df-4640-ad6a-9719d334a26c</entry>
Jul 24 15:13:52 user nova-compute[70645]:       <entry name="uuid">936cb284-e0df-4640-ad6a-9719d334a26c</entry>
Jul 24 15:13:52 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:13:52 user nova-compute[70645]:     </system>
Jul 24 15:13:52 user nova-compute[70645]:   </sysinfo>
Jul 24 15:13:52 user nova-compute[70645]:   <os>
Jul 24 15:13:52 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:13:52 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:13:52 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:13:52 user nova-compute[70645]:   </os>
Jul 24 15:13:52 user nova-compute[70645]:   <features>
Jul 24 15:13:52 user nova-compute[70645]:     <acpi/>
Jul 24 15:13:52 user nova-compute[70645]:     <apic/>
Jul 24 15:13:52 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:13:52 user nova-compute[70645]:   </features>
Jul 24 15:13:52 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:13:52 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:13:52 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:13:52 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:13:52 user nova-compute[70645]:   </clock>
Jul 24 15:13:52 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:13:52 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:13:52 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:13:52 user nova-compute[70645]:   </cpu>
Jul 24 15:13:52 user nova-compute[70645]:   <devices>
Jul 24 15:13:52 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:13:52 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:13:52 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk"/>
Jul 24 15:13:52 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:13:52 user nova-compute[70645]:     </disk>
Jul 24 15:13:52 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:13:52 user nova-compute[70645]:       <mac address="fa:16:3e:68:d7:02"/>
Jul 24 15:13:52 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:13:52 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:13:52 user nova-compute[70645]:       <target dev="tapb3256b72-7d"/>
Jul 24 15:13:52 user nova-compute[70645]:     </interface>
Jul 24 15:13:52 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:13:52 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/console.log" append="off"/>
Jul 24 15:13:52 user nova-compute[70645]:     </serial>
Jul 24 15:13:52 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:13:52 user nova-compute[70645]:     <video>
Jul 24 15:13:52 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:13:52 user nova-compute[70645]:     </video>
Jul 24 15:13:52 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:13:52 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:13:52 user nova-compute[70645]:     </rng>
Jul 24 15:13:52 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:13:52 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:13:52 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:13:52 user nova-compute[70645]:     </memballoon>
Jul 24 15:13:52 user nova-compute[70645]:   </devices>
Jul 24 15:13:52 user nova-compute[70645]: </domain>
Jul 24 15:13:52 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1039009520',display_name='tempest-AttachVolumeNegativeTest-server-1039009520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1039009520',id=38,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh/JZ3YxLZ5fvpdm1Uo19kj4TE2PMVgkdngKCZzySwQKZ9gkap4gWcTWkpN8EhS29LH18A/u4J+mheHTw1k7ZsT0Yb38KaRqxcu65QlRIw2hVrsPSEz9re174lxKV0Aqg==',key_name='tempest-keypair-405716000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-0i0krm5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:13:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=936cb284-e0df-4640-ad6a-9719d334a26c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=b3256b72-7d12-4211-af7c-8c3309af4b3b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3256b72-7d') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG os_vif [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=b3256b72-7d12-4211-af7c-8c3309af4b3b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3256b72-7d') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3256b72-7d, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3256b72-7d, col_values=(('external_ids', {'iface-id': 'b3256b72-7d12-4211-af7c-8c3309af4b3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:d7:02', 'vm-uuid': '936cb284-e0df-4640-ad6a-9719d334a26c'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:52 user nova-compute[70645]: INFO os_vif [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=b3256b72-7d12-4211-af7c-8c3309af4b3b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3256b72-7d')
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No VIF found with MAC fa:16:3e:68:d7:02, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-fcbaa4a1-6bd3-407c-9e5c-469a7283ba1e req-c4b745c7-55c7-47e6-8432-43087123f84e service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Updated VIF entry in instance network info cache for port b3256b72-7d12-4211-af7c-8c3309af4b3b. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-fcbaa4a1-6bd3-407c-9e5c-469a7283ba1e req-c4b745c7-55c7-47e6-8432-43087123f84e service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Updating instance_info_cache with network_info: [{"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:13:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fcbaa4a1-6bd3-407c-9e5c-469a7283ba1e req-c4b745c7-55c7-47e6-8432-43087123f84e service nova] Releasing lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211633.252094, 47016839-ba35-418a-af61-d2b9ed1ffccc => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:13:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] VM Resumed (Lifecycle Event)
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:13:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Instance spawned successfully.
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211633.258944, 47016839-ba35-418a-af61-d2b9ed1ffccc => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:13:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] VM Started (Lifecycle Event)
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-e0a91e6b-37ff-4b4c-92b5-5bebc88b06df req-c629b54a-599f-40a0-ba69-8fa8b586fc59 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received event network-vif-plugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e0a91e6b-37ff-4b4c-92b5-5bebc88b06df req-c629b54a-599f-40a0-ba69-8fa8b586fc59 service nova] Acquiring lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e0a91e6b-37ff-4b4c-92b5-5bebc88b06df req-c629b54a-599f-40a0-ba69-8fa8b586fc59 service nova] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e0a91e6b-37ff-4b4c-92b5-5bebc88b06df req-c629b54a-599f-40a0-ba69-8fa8b586fc59 service nova] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-e0a91e6b-37ff-4b4c-92b5-5bebc88b06df req-c629b54a-599f-40a0-ba69-8fa8b586fc59 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] No waiting events found dispatching network-vif-plugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:13:53 user nova-compute[70645]: WARNING nova.compute.manager [req-e0a91e6b-37ff-4b4c-92b5-5bebc88b06df req-c629b54a-599f-40a0-ba69-8fa8b586fc59 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received unexpected event network-vif-plugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 for instance with vm_state building and task_state spawning.
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:13:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:13:53 user nova-compute[70645]: INFO nova.compute.manager [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Took 7.24 seconds to spawn the instance on the hypervisor.
Jul 24 15:13:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:53 user nova-compute[70645]: INFO nova.compute.manager [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Took 8.06 seconds to build instance.
Jul 24 15:13:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8a3e981b-5e1e-4143-a62d-2033a71773fd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.165s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Received event network-vif-plugged-b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] Acquiring lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] Lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] Lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] No waiting events found dispatching network-vif-plugged-b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:13:55 user nova-compute[70645]: WARNING nova.compute.manager [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Received unexpected event network-vif-plugged-b3256b72-7d12-4211-af7c-8c3309af4b3b for instance with vm_state building and task_state spawning.
Jul 24 15:13:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Received event network-vif-plugged-b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:13:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] Acquiring lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:13:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] Lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:13:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] Lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] No waiting events found dispatching network-vif-plugged-b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:13:55 user nova-compute[70645]: WARNING nova.compute.manager [req-013281e8-dab3-434e-945d-934d2e5fc154 req-63ae909d-70bc-40e6-af7f-7553d5230cf8 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Received unexpected event network-vif-plugged-b3256b72-7d12-4211-af7c-8c3309af4b3b for instance with vm_state building and task_state spawning.
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211636.7925098, 936cb284-e0df-4640-ad6a-9719d334a26c => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:13:56 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] VM Resumed (Lifecycle Event)
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:13:56 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Instance spawned successfully.
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:13:56 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211636.796018, 936cb284-e0df-4640-ad6a-9719d334a26c => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:13:56 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] VM Started (Lifecycle Event)
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:13:56 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:13:56 user nova-compute[70645]: INFO nova.compute.manager [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Took 6.83 seconds to spawn the instance on the hypervisor.
Jul 24 15:13:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:13:57 user nova-compute[70645]: INFO nova.compute.manager [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Took 7.73 seconds to build instance.
Jul 24 15:13:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e222fdd7-d9fa-44d2-b756-f96b0e2e06ae tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.877s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:13:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:13:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Acquiring lock "c71a9a04-efaf-4cdf-b494-d84412030cbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:00 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:14:01 user nova-compute[70645]: INFO nova.compute.claims [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Claim successful on node user
Jul 24 15:14:01 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:14:01 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:14:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:14:01 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Creating image(s)
Jul 24 15:14:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Acquiring lock "/opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "/opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "/opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG nova.policy [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef4ab3cfe7154e23b207a91fbfc0f098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd121c171b01f41258fa98bbca07d3b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.197s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk 1073741824" returned: 0 in 0.061s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.170s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Cannot resize image /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lazy-loading 'migration_context' on Instance uuid c71a9a04-efaf-4cdf-b494-d84412030cbf {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Ensure instance console log exists: /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:02 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Successfully created port: 82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Successfully updated port: 82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Acquiring lock "refresh_cache-c71a9a04-efaf-4cdf-b494-d84412030cbf" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Acquired lock "refresh_cache-c71a9a04-efaf-4cdf-b494-d84412030cbf" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-4d5d030f-f97e-4b19-ba5e-a785a0c37359 req-d0d9ea85-e84b-457c-b4ad-98bd4248393c service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Received event network-changed-82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG nova.compute.manager [req-4d5d030f-f97e-4b19-ba5e-a785a0c37359 req-d0d9ea85-e84b-457c-b4ad-98bd4248393c service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Refreshing instance network info cache due to event network-changed-82146887-3639-4df8-a4f6-297b76202ac8. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4d5d030f-f97e-4b19-ba5e-a785a0c37359 req-d0d9ea85-e84b-457c-b4ad-98bd4248393c service nova] Acquiring lock "refresh_cache-c71a9a04-efaf-4cdf-b494-d84412030cbf" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG nova.network.neutron [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Updating instance_info_cache with network_info: [{"id": "82146887-3639-4df8-a4f6-297b76202ac8", "address": "fa:16:3e:75:56:02", "network": {"id": "bcbfafb1-3c65-47e9-9058-32fd5a3225f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b65d0636576c475486adf5aa6fbed00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82146887-36", "ovs_interfaceid": "82146887-3639-4df8-a4f6-297b76202ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Releasing lock "refresh_cache-c71a9a04-efaf-4cdf-b494-d84412030cbf" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Instance network_info: |[{"id": "82146887-3639-4df8-a4f6-297b76202ac8", "address": "fa:16:3e:75:56:02", "network": {"id": "bcbfafb1-3c65-47e9-9058-32fd5a3225f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b65d0636576c475486adf5aa6fbed00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82146887-36", "ovs_interfaceid": "82146887-3639-4df8-a4f6-297b76202ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4d5d030f-f97e-4b19-ba5e-a785a0c37359 req-d0d9ea85-e84b-457c-b4ad-98bd4248393c service nova] Acquired lock "refresh_cache-c71a9a04-efaf-4cdf-b494-d84412030cbf" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG nova.network.neutron [req-4d5d030f-f97e-4b19-ba5e-a785a0c37359 req-d0d9ea85-e84b-457c-b4ad-98bd4248393c service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Refreshing network info cache for port 82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:14:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Start _get_guest_xml network_info=[{"id": "82146887-3639-4df8-a4f6-297b76202ac8", "address": "fa:16:3e:75:56:02", "network": {"id": "bcbfafb1-3c65-47e9-9058-32fd5a3225f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b65d0636576c475486adf5aa6fbed00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82146887-36", "ovs_interfaceid": "82146887-3639-4df8-a4f6-297b76202ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:14:03 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:14:03 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1230455807',display_name='tempest-VolumesNegativeTest-instance-1230455807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1230455807',id=39,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d121c171b01f41258fa98bbca07d3b63',ramdisk_id='',reservation_id='r-dep0spe7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-798127368',owner_user_name='tempest-VolumesNegativeTest-798127368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:14:02Z,user_data=None,user_id='ef4ab3cfe7154e23b207a91fbfc0f098',uuid=c71a9a04-efaf-4cdf-b494-d84412030cbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82146887-3639-4df8-a4f6-297b76202ac8", "address": "fa:16:3e:75:56:02", "network": {"id": "bcbfafb1-3c65-47e9-9058-32fd5a3225f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b65d0636576c475486adf5aa6fbed00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82146887-36", "ovs_interfaceid": "82146887-3639-4df8-a4f6-297b76202ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Converting VIF {"id": "82146887-3639-4df8-a4f6-297b76202ac8", "address": "fa:16:3e:75:56:02", "network": {"id": "bcbfafb1-3c65-47e9-9058-32fd5a3225f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b65d0636576c475486adf5aa6fbed00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82146887-36", "ovs_interfaceid": "82146887-3639-4df8-a4f6-297b76202ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:56:02,bridge_name='br-int',has_traffic_filtering=True,id=82146887-3639-4df8-a4f6-297b76202ac8,network=Network(bcbfafb1-3c65-47e9-9058-32fd5a3225f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82146887-36') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lazy-loading 'pci_devices' on Instance uuid c71a9a04-efaf-4cdf-b494-d84412030cbf {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:14:04 user nova-compute[70645]:   <uuid>c71a9a04-efaf-4cdf-b494-d84412030cbf</uuid>
Jul 24 15:14:04 user nova-compute[70645]:   <name>instance-00000027</name>
Jul 24 15:14:04 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:14:04 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:14:04 user nova-compute[70645]:   <metadata>
Jul 24 15:14:04 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:14:04 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:14:04 user nova-compute[70645]:       <nova:name>tempest-VolumesNegativeTest-instance-1230455807</nova:name>
Jul 24 15:14:04 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:14:03</nova:creationTime>
Jul 24 15:14:04 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:14:04 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:14:04 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:14:04 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:14:04 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:14:04 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:14:04 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:14:04 user nova-compute[70645]:       <nova:owner>
Jul 24 15:14:04 user nova-compute[70645]:         <nova:user uuid="ef4ab3cfe7154e23b207a91fbfc0f098">tempest-VolumesNegativeTest-798127368-project-member</nova:user>
Jul 24 15:14:04 user nova-compute[70645]:         <nova:project uuid="d121c171b01f41258fa98bbca07d3b63">tempest-VolumesNegativeTest-798127368</nova:project>
Jul 24 15:14:04 user nova-compute[70645]:       </nova:owner>
Jul 24 15:14:04 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:14:04 user nova-compute[70645]:       <nova:ports>
Jul 24 15:14:04 user nova-compute[70645]:         <nova:port uuid="82146887-3639-4df8-a4f6-297b76202ac8">
Jul 24 15:14:04 user nova-compute[70645]:           <nova:ip type="fixed" address="192.168.233.119" ipVersion="4"/>
Jul 24 15:14:04 user nova-compute[70645]:         </nova:port>
Jul 24 15:14:04 user nova-compute[70645]:       </nova:ports>
Jul 24 15:14:04 user nova-compute[70645]:     </nova:instance>
Jul 24 15:14:04 user nova-compute[70645]:   </metadata>
Jul 24 15:14:04 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:14:04 user nova-compute[70645]:     <system>
Jul 24 15:14:04 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:14:04 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:14:04 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:14:04 user nova-compute[70645]:       <entry name="serial">c71a9a04-efaf-4cdf-b494-d84412030cbf</entry>
Jul 24 15:14:04 user nova-compute[70645]:       <entry name="uuid">c71a9a04-efaf-4cdf-b494-d84412030cbf</entry>
Jul 24 15:14:04 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:14:04 user nova-compute[70645]:     </system>
Jul 24 15:14:04 user nova-compute[70645]:   </sysinfo>
Jul 24 15:14:04 user nova-compute[70645]:   <os>
Jul 24 15:14:04 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:14:04 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:14:04 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:14:04 user nova-compute[70645]:   </os>
Jul 24 15:14:04 user nova-compute[70645]:   <features>
Jul 24 15:14:04 user nova-compute[70645]:     <acpi/>
Jul 24 15:14:04 user nova-compute[70645]:     <apic/>
Jul 24 15:14:04 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:14:04 user nova-compute[70645]:   </features>
Jul 24 15:14:04 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:14:04 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:14:04 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:14:04 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:14:04 user nova-compute[70645]:   </clock>
Jul 24 15:14:04 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:14:04 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:14:04 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:14:04 user nova-compute[70645]:   </cpu>
Jul 24 15:14:04 user nova-compute[70645]:   <devices>
Jul 24 15:14:04 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:14:04 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:14:04 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk"/>
Jul 24 15:14:04 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:14:04 user nova-compute[70645]:     </disk>
Jul 24 15:14:04 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:14:04 user nova-compute[70645]:       <mac address="fa:16:3e:75:56:02"/>
Jul 24 15:14:04 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:14:04 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:14:04 user nova-compute[70645]:       <target dev="tap82146887-36"/>
Jul 24 15:14:04 user nova-compute[70645]:     </interface>
Jul 24 15:14:04 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:14:04 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/console.log" append="off"/>
Jul 24 15:14:04 user nova-compute[70645]:     </serial>
Jul 24 15:14:04 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:14:04 user nova-compute[70645]:     <video>
Jul 24 15:14:04 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:14:04 user nova-compute[70645]:     </video>
Jul 24 15:14:04 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:14:04 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:14:04 user nova-compute[70645]:     </rng>
Jul 24 15:14:04 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:14:04 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:14:04 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:14:04 user nova-compute[70645]:     </memballoon>
Jul 24 15:14:04 user nova-compute[70645]:   </devices>
Jul 24 15:14:04 user nova-compute[70645]: </domain>
Jul 24 15:14:04 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1230455807',display_name='tempest-VolumesNegativeTest-instance-1230455807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1230455807',id=39,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d121c171b01f41258fa98bbca07d3b63',ramdisk_id='',reservation_id='r-dep0spe7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-798127368',owner_user_name='tempest-VolumesNegativeTest-798127368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:14:02Z,user_data=None,user_id='ef4ab3cfe7154e23b207a91fbfc0f098',uuid=c71a9a04-efaf-4cdf-b494-d84412030cbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82146887-3639-4df8-a4f6-297b76202ac8", "address": "fa:16:3e:75:56:02", "network": {"id": "bcbfafb1-3c65-47e9-9058-32fd5a3225f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b65d0636576c475486adf5aa6fbed00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82146887-36", "ovs_interfaceid": "82146887-3639-4df8-a4f6-297b76202ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Converting VIF {"id": "82146887-3639-4df8-a4f6-297b76202ac8", "address": "fa:16:3e:75:56:02", "network": {"id": "bcbfafb1-3c65-47e9-9058-32fd5a3225f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b65d0636576c475486adf5aa6fbed00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82146887-36", "ovs_interfaceid": "82146887-3639-4df8-a4f6-297b76202ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:56:02,bridge_name='br-int',has_traffic_filtering=True,id=82146887-3639-4df8-a4f6-297b76202ac8,network=Network(bcbfafb1-3c65-47e9-9058-32fd5a3225f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82146887-36') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG os_vif [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:56:02,bridge_name='br-int',has_traffic_filtering=True,id=82146887-3639-4df8-a4f6-297b76202ac8,network=Network(bcbfafb1-3c65-47e9-9058-32fd5a3225f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82146887-36') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82146887-36, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82146887-36, col_values=(('external_ids', {'iface-id': '82146887-3639-4df8-a4f6-297b76202ac8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:56:02', 'vm-uuid': 'c71a9a04-efaf-4cdf-b494-d84412030cbf'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:04 user nova-compute[70645]: INFO os_vif [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:56:02,bridge_name='br-int',has_traffic_filtering=True,id=82146887-3639-4df8-a4f6-297b76202ac8,network=Network(bcbfafb1-3c65-47e9-9058-32fd5a3225f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82146887-36')
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] No VIF found with MAC fa:16:3e:75:56:02, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.network.neutron [req-4d5d030f-f97e-4b19-ba5e-a785a0c37359 req-d0d9ea85-e84b-457c-b4ad-98bd4248393c service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Updated VIF entry in instance network info cache for port 82146887-3639-4df8-a4f6-297b76202ac8. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.network.neutron [req-4d5d030f-f97e-4b19-ba5e-a785a0c37359 req-d0d9ea85-e84b-457c-b4ad-98bd4248393c service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Updating instance_info_cache with network_info: [{"id": "82146887-3639-4df8-a4f6-297b76202ac8", "address": "fa:16:3e:75:56:02", "network": {"id": "bcbfafb1-3c65-47e9-9058-32fd5a3225f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b65d0636576c475486adf5aa6fbed00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82146887-36", "ovs_interfaceid": "82146887-3639-4df8-a4f6-297b76202ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4d5d030f-f97e-4b19-ba5e-a785a0c37359 req-d0d9ea85-e84b-457c-b4ad-98bd4248393c service nova] Releasing lock "refresh_cache-c71a9a04-efaf-4cdf-b494-d84412030cbf" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "cf8bcde0-6825-45f0-85c3-14188211558c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:04 user nova-compute[70645]: INFO nova.compute.manager [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Terminating instance
Jul 24 15:14:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-bbd1256b-afe4-4320-beda-df3ade28df04 req-16bf2cdc-4a57-4785-baac-ed5b7fac09cd service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received event network-vif-unplugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bbd1256b-afe4-4320-beda-df3ade28df04 req-16bf2cdc-4a57-4785-baac-ed5b7fac09cd service nova] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bbd1256b-afe4-4320-beda-df3ade28df04 req-16bf2cdc-4a57-4785-baac-ed5b7fac09cd service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bbd1256b-afe4-4320-beda-df3ade28df04 req-16bf2cdc-4a57-4785-baac-ed5b7fac09cd service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-bbd1256b-afe4-4320-beda-df3ade28df04 req-16bf2cdc-4a57-4785-baac-ed5b7fac09cd service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] No waiting events found dispatching network-vif-unplugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-bbd1256b-afe4-4320-beda-df3ade28df04 req-16bf2cdc-4a57-4785-baac-ed5b7fac09cd service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received event network-vif-unplugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-9576831e-fdbd-42a9-a05e-e914074b8b7f req-1891f5c6-d850-4cc1-a177-b62dd7c8d4dc service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Received event network-vif-plugged-82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9576831e-fdbd-42a9-a05e-e914074b8b7f req-1891f5c6-d850-4cc1-a177-b62dd7c8d4dc service nova] Acquiring lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9576831e-fdbd-42a9-a05e-e914074b8b7f req-1891f5c6-d850-4cc1-a177-b62dd7c8d4dc service nova] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9576831e-fdbd-42a9-a05e-e914074b8b7f req-1891f5c6-d850-4cc1-a177-b62dd7c8d4dc service nova] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-9576831e-fdbd-42a9-a05e-e914074b8b7f req-1891f5c6-d850-4cc1-a177-b62dd7c8d4dc service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] No waiting events found dispatching network-vif-plugged-82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:14:06 user nova-compute[70645]: WARNING nova.compute.manager [req-9576831e-fdbd-42a9-a05e-e914074b8b7f req-1891f5c6-d850-4cc1-a177-b62dd7c8d4dc service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Received unexpected event network-vif-plugged-82146887-3639-4df8-a4f6-297b76202ac8 for instance with vm_state building and task_state spawning.
Jul 24 15:14:06 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Instance destroyed successfully.
Jul 24 15:14:06 user nova-compute[70645]: DEBUG nova.objects.instance [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'resources' on Instance uuid cf8bcde0-6825-45f0-85c3-14188211558c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-999275839',display_name='tempest-ServerRescueNegativeTestJSON-server-999275839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-999275839',id=20,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T14:59:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-wjnojzx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T14:59:50Z,user_data=None,user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=cf8bcde0-6825-45f0-85c3-14188211558c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "address": "fa:16:3e:f2:f0:91", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa192fa1c-14", "ovs_interfaceid": "a192fa1c-1413-4f9a-bb16-8fd758373ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:f0:91,bridge_name='br-int',has_traffic_filtering=True,id=a192fa1c-1413-4f9a-bb16-8fd758373ce9,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa192fa1c-14') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG os_vif [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:f0:91,bridge_name='br-int',has_traffic_filtering=True,id=a192fa1c-1413-4f9a-bb16-8fd758373ce9,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa192fa1c-14') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa192fa1c-14, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:14:06 user nova-compute[70645]: INFO os_vif [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:f0:91,bridge_name='br-int',has_traffic_filtering=True,id=a192fa1c-1413-4f9a-bb16-8fd758373ce9,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa192fa1c-14')
Jul 24 15:14:06 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Deleting instance files /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c_del
Jul 24 15:14:06 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Deletion of /opt/stack/data/nova/instances/cf8bcde0-6825-45f0-85c3-14188211558c_del complete
Jul 24 15:14:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:06 user nova-compute[70645]: INFO nova.compute.manager [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Took 1.59 seconds to destroy the instance on the hypervisor.
Jul 24 15:14:06 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:14:06 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:14:07 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:14:07 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Took 0.87 seconds to deallocate network for instance.
Jul 24 15:14:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e3ada09-0824-46c1-90fa-7ec9960577c6 req-06326f16-a640-4f84-b87f-c0b4d3db392c service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received event network-vif-deleted-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:07 user nova-compute[70645]: INFO nova.compute.manager [req-3e3ada09-0824-46c1-90fa-7ec9960577c6 req-06326f16-a640-4f84-b87f-c0b4d3db392c service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Neutron deleted interface a192fa1c-1413-4f9a-bb16-8fd758373ce9; detaching it from the instance and deleting it from the info cache
Jul 24 15:14:07 user nova-compute[70645]: DEBUG nova.network.neutron [req-3e3ada09-0824-46c1-90fa-7ec9960577c6 req-06326f16-a640-4f84-b87f-c0b4d3db392c service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:14:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-c28ec19d-5c3f-45af-9ce7-f79fb2a324a7 req-16ec0584-8d93-4c98-b801-30cd3d674ceb service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c28ec19d-5c3f-45af-9ce7-f79fb2a324a7 req-16ec0584-8d93-4c98-b801-30cd3d674ceb service nova] Acquiring lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c28ec19d-5c3f-45af-9ce7-f79fb2a324a7 req-16ec0584-8d93-4c98-b801-30cd3d674ceb service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c28ec19d-5c3f-45af-9ce7-f79fb2a324a7 req-16ec0584-8d93-4c98-b801-30cd3d674ceb service nova] Lock "cf8bcde0-6825-45f0-85c3-14188211558c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-c28ec19d-5c3f-45af-9ce7-f79fb2a324a7 req-16ec0584-8d93-4c98-b801-30cd3d674ceb service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] No waiting events found dispatching network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:14:07 user nova-compute[70645]: WARNING nova.compute.manager [req-c28ec19d-5c3f-45af-9ce7-f79fb2a324a7 req-16ec0584-8d93-4c98-b801-30cd3d674ceb service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Received unexpected event network-vif-plugged-a192fa1c-1413-4f9a-bb16-8fd758373ce9 for instance with vm_state rescued and task_state deleting.
Jul 24 15:14:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-3e3ada09-0824-46c1-90fa-7ec9960577c6 req-06326f16-a640-4f84-b87f-c0b4d3db392c service nova] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Detach interface failed, port_id=a192fa1c-1413-4f9a-bb16-8fd758373ce9, reason: Instance cf8bcde0-6825-45f0-85c3-14188211558c could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:14:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:07 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:14:07 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:14:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:07 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Deleted allocations for instance cf8bcde0-6825-45f0-85c3-14188211558c
Jul 24 15:14:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-36179faf-02ca-4d95-87fb-3edfa7af90c2 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "cf8bcde0-6825-45f0-85c3-14188211558c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.093s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.compute.manager [req-afecd57a-59e1-4c74-83b3-23bfa2ec4eae req-cf22e836-5443-46d4-a141-16cb3b9e5dee service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Received event network-vif-plugged-82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-afecd57a-59e1-4c74-83b3-23bfa2ec4eae req-cf22e836-5443-46d4-a141-16cb3b9e5dee service nova] Acquiring lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-afecd57a-59e1-4c74-83b3-23bfa2ec4eae req-cf22e836-5443-46d4-a141-16cb3b9e5dee service nova] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-afecd57a-59e1-4c74-83b3-23bfa2ec4eae req-cf22e836-5443-46d4-a141-16cb3b9e5dee service nova] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.compute.manager [req-afecd57a-59e1-4c74-83b3-23bfa2ec4eae req-cf22e836-5443-46d4-a141-16cb3b9e5dee service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] No waiting events found dispatching network-vif-plugged-82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:14:08 user nova-compute[70645]: WARNING nova.compute.manager [req-afecd57a-59e1-4c74-83b3-23bfa2ec4eae req-cf22e836-5443-46d4-a141-16cb3b9e5dee service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Received unexpected event network-vif-plugged-82146887-3639-4df8-a4f6-297b76202ac8 for instance with vm_state building and task_state spawning.
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211648.3707788, c71a9a04-efaf-4cdf-b494-d84412030cbf => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:14:08 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] VM Resumed (Lifecycle Event)
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:14:08 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Instance spawned successfully.
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:14:08 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211648.371933, c71a9a04-efaf-4cdf-b494-d84412030cbf => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:14:08 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] VM Started (Lifecycle Event)
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:14:08 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:14:08 user nova-compute[70645]: INFO nova.compute.manager [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Took 6.81 seconds to spawn the instance on the hypervisor.
Jul 24 15:14:08 user nova-compute[70645]: DEBUG nova.compute.manager [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:14:08 user nova-compute[70645]: INFO nova.compute.manager [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Took 7.80 seconds to build instance.
Jul 24 15:14:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-2d7775c4-6407-4d22-aa8c-64d6cd3d05c5 tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.931s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:19 user nova-compute[70645]: INFO nova.compute.manager [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Terminating instance
Jul 24 15:14:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-793bb34a-7ab5-4f80-8136-5ec81c25b03c req-ea4e1fbf-63cd-4925-bbd2-60efff9ca383 service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Received event network-vif-unplugged-a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-793bb34a-7ab5-4f80-8136-5ec81c25b03c req-ea4e1fbf-63cd-4925-bbd2-60efff9ca383 service nova] Acquiring lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-793bb34a-7ab5-4f80-8136-5ec81c25b03c req-ea4e1fbf-63cd-4925-bbd2-60efff9ca383 service nova] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-793bb34a-7ab5-4f80-8136-5ec81c25b03c req-ea4e1fbf-63cd-4925-bbd2-60efff9ca383 service nova] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-793bb34a-7ab5-4f80-8136-5ec81c25b03c req-ea4e1fbf-63cd-4925-bbd2-60efff9ca383 service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] No waiting events found dispatching network-vif-unplugged-a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:14:19 user nova-compute[70645]: DEBUG nova.compute.manager [req-793bb34a-7ab5-4f80-8136-5ec81c25b03c req-ea4e1fbf-63cd-4925-bbd2-60efff9ca383 service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Received event network-vif-unplugged-a605a24e-447e-4dac-af86-14d665fa2391 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:14:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Instance destroyed successfully.
Jul 24 15:14:20 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lazy-loading 'resources' on Instance uuid 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-784477117',display_name='tempest-ServersNegativeTestJSON-server-784477117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-784477117',id=30,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3f2a4081bd346928d0e316e7e856479',ramdisk_id='',reservation_id='r-wzp30pfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-118608074',owner_user_name='tempest-ServersNegativeTestJSON-118608074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:05:37Z,user_data=None,user_id='7baae1cced074129abc9c7e46a69001e',uuid=5bc347f4-5487-4e88-96d5-9b2f411cb1e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a605a24e-447e-4dac-af86-14d665fa2391", "address": "fa:16:3e:e3:ce:5e", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa605a24e-44", "ovs_interfaceid": "a605a24e-447e-4dac-af86-14d665fa2391", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converting VIF {"id": "a605a24e-447e-4dac-af86-14d665fa2391", "address": "fa:16:3e:e3:ce:5e", "network": {"id": "5a5ccca4-e86f-4214-a979-0e2ac38254b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649969131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3f2a4081bd346928d0e316e7e856479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa605a24e-44", "ovs_interfaceid": "a605a24e-447e-4dac-af86-14d665fa2391", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ce:5e,bridge_name='br-int',has_traffic_filtering=True,id=a605a24e-447e-4dac-af86-14d665fa2391,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa605a24e-44') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG os_vif [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ce:5e,bridge_name='br-int',has_traffic_filtering=True,id=a605a24e-447e-4dac-af86-14d665fa2391,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa605a24e-44') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa605a24e-44, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:14:20 user nova-compute[70645]: INFO os_vif [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ce:5e,bridge_name='br-int',has_traffic_filtering=True,id=a605a24e-447e-4dac-af86-14d665fa2391,network=Network(5a5ccca4-e86f-4214-a979-0e2ac38254b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa605a24e-44')
Jul 24 15:14:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Deleting instance files /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4_del
Jul 24 15:14:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Deletion of /opt/stack/data/nova/instances/5bc347f4-5487-4e88-96d5-9b2f411cb1e4_del complete
Jul 24 15:14:20 user nova-compute[70645]: INFO nova.compute.manager [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Took 0.71 seconds to destroy the instance on the hypervisor.
Jul 24 15:14:20 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:14:20 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Took 0.49 seconds to deallocate network for instance.
Jul 24 15:14:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1d493ea-d6c4-4d55-b1b1-c1ee95855e0a req-73aa866f-3e62-4b0d-8e12-201df47668ff service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Received event network-vif-deleted-a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:20 user nova-compute[70645]: INFO nova.compute.manager [req-f1d493ea-d6c4-4d55-b1b1-c1ee95855e0a req-73aa866f-3e62-4b0d-8e12-201df47668ff service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Neutron deleted interface a605a24e-447e-4dac-af86-14d665fa2391; detaching it from the instance and deleting it from the info cache
Jul 24 15:14:20 user nova-compute[70645]: DEBUG nova.network.neutron [req-f1d493ea-d6c4-4d55-b1b1-c1ee95855e0a req-73aa866f-3e62-4b0d-8e12-201df47668ff service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1d493ea-d6c4-4d55-b1b1-c1ee95855e0a req-73aa866f-3e62-4b0d-8e12-201df47668ff service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Detach interface failed, port_id=a605a24e-447e-4dac-af86-14d665fa2391, reason: Instance 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:21 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:14:21 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:14:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:21 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Deleted allocations for instance 5bc347f4-5487-4e88-96d5-9b2f411cb1e4
Jul 24 15:14:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4cf9ae1b-bf49-406f-9766-149a67ee972e tempest-ServersNegativeTestJSON-118608074 tempest-ServersNegativeTestJSON-118608074-project-member] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.738s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:21 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211646.3274977, cf8bcde0-6825-45f0-85c3-14188211558c => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:14:21 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] VM Stopped (Lifecycle Event)
Jul 24 15:14:21 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1ed30631-54ad-4eac-94fb-81a266c89c23 None None] [instance: cf8bcde0-6825-45f0-85c3-14188211558c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:14:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d9ff5da-366d-4fa0-8efc-ee13e10755f6 req-aa0ce6f0-3feb-429e-bb2f-644a81e5140f service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Received event network-vif-plugged-a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d9ff5da-366d-4fa0-8efc-ee13e10755f6 req-aa0ce6f0-3feb-429e-bb2f-644a81e5140f service nova] Acquiring lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d9ff5da-366d-4fa0-8efc-ee13e10755f6 req-aa0ce6f0-3feb-429e-bb2f-644a81e5140f service nova] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8d9ff5da-366d-4fa0-8efc-ee13e10755f6 req-aa0ce6f0-3feb-429e-bb2f-644a81e5140f service nova] Lock "5bc347f4-5487-4e88-96d5-9b2f411cb1e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:21 user nova-compute[70645]: DEBUG nova.compute.manager [req-8d9ff5da-366d-4fa0-8efc-ee13e10755f6 req-aa0ce6f0-3feb-429e-bb2f-644a81e5140f service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] No waiting events found dispatching network-vif-plugged-a605a24e-447e-4dac-af86-14d665fa2391 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:14:21 user nova-compute[70645]: WARNING nova.compute.manager [req-8d9ff5da-366d-4fa0-8efc-ee13e10755f6 req-aa0ce6f0-3feb-429e-bb2f-644a81e5140f service nova] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Received unexpected event network-vif-plugged-a605a24e-447e-4dac-af86-14d665fa2391 for instance with vm_state deleted and task_state None.
Jul 24 15:14:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:14:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:14:30 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:14:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:30 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:31 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:14:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:14:32 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:14:32 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:14:32 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=7716MB free_disk=25.335586547851562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:14:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 74c53188-2399-4515-94e6-4ff3e94d7559 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 012bb476-47bc-4bfc-96aa-c53fe1d7de6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 1372f999-32a0-4079-ab57-597093017d8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 47016839-ba35-418a-af61-d2b9ed1ffccc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 936cb284-e0df-4640-ad6a-9719d334a26c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance c71a9a04-efaf-4cdf-b494-d84412030cbf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing inventories for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Updating ProviderTree inventory for provider a0cf5b80-69d2-4191-894e-a498eab7d688 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing aggregate associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, aggregates: None {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing trait associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:14:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211660.0302515, 5bc347f4-5487-4e88-96d5-9b2f411cb1e4 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:14:35 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] VM Stopped (Lifecycle Event)
Jul 24 15:14:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-f5e13039-e65c-4bf8-8a8a-720b17cdcb36 None None] [instance: 5bc347f4-5487-4e88-96d5-9b2f411cb1e4] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Updating instance_info_cache with network_info: [{"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-74c53188-2399-4515-94e6-4ff3e94d7559" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:14:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:14:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:14:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:14:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:39 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:14:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:14:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "74c53188-2399-4515-94e6-4ff3e94d7559" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:55 user nova-compute[70645]: INFO nova.compute.manager [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Terminating instance
Jul 24 15:14:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-5723bed5-b2e2-4272-8eb6-1bbf56cb54d2 req-8ed4b4a3-4f20-4e5d-b7ea-0dfeb073ca27 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-unplugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5723bed5-b2e2-4272-8eb6-1bbf56cb54d2 req-8ed4b4a3-4f20-4e5d-b7ea-0dfeb073ca27 service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5723bed5-b2e2-4272-8eb6-1bbf56cb54d2 req-8ed4b4a3-4f20-4e5d-b7ea-0dfeb073ca27 service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5723bed5-b2e2-4272-8eb6-1bbf56cb54d2 req-8ed4b4a3-4f20-4e5d-b7ea-0dfeb073ca27 service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-5723bed5-b2e2-4272-8eb6-1bbf56cb54d2 req-8ed4b4a3-4f20-4e5d-b7ea-0dfeb073ca27 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-unplugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG nova.compute.manager [req-5723bed5-b2e2-4272-8eb6-1bbf56cb54d2 req-8ed4b4a3-4f20-4e5d-b7ea-0dfeb073ca27 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-unplugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:14:55 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Instance destroyed successfully.
Jul 24 15:14:55 user nova-compute[70645]: DEBUG nova.objects.instance [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lazy-loading 'resources' on Instance uuid 74c53188-2399-4515-94e6-4ff3e94d7559 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T14:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998066313',display_name='tempest-ServerRescueNegativeTestJSON-server-998066313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998066313',id=19,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:02:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3f8500e5a144902be74f12f3caf8ae2',ramdisk_id='',reservation_id='r-8dcvtzzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1652524619',owner_user_name='tempest-ServerRescueNegativeTestJSON-1652524619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:04:34Z,user_data=None,user_id='74440f1d0cf141fdb6b40b0d1e3a5d13',uuid=74c53188-2399-4515-94e6-4ff3e94d7559,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converting VIF {"id": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "address": "fa:16:3e:ae:bb:83", "network": {"id": "9e266368-7afc-4623-964b-0e418d1607b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-277331928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f8500e5a144902be74f12f3caf8ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4da7fd3-48", "ovs_interfaceid": "a4da7fd3-4861-41a6-ad8c-d9326d1b7160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=a4da7fd3-4861-41a6-ad8c-d9326d1b7160,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4da7fd3-48') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:14:55 user nova-compute[70645]: DEBUG os_vif [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=a4da7fd3-4861-41a6-ad8c-d9326d1b7160,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4da7fd3-48') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4da7fd3-48, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:14:56 user nova-compute[70645]: INFO os_vif [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=a4da7fd3-4861-41a6-ad8c-d9326d1b7160,network=Network(9e266368-7afc-4623-964b-0e418d1607b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4da7fd3-48')
Jul 24 15:14:56 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Deleting instance files /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559_del
Jul 24 15:14:56 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Deletion of /opt/stack/data/nova/instances/74c53188-2399-4515-94e6-4ff3e94d7559_del complete
Jul 24 15:14:56 user nova-compute[70645]: INFO nova.compute.manager [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Took 0.67 seconds to destroy the instance on the hypervisor.
Jul 24 15:14:56 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:14:56 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Took 0.48 seconds to deallocate network for instance.
Jul 24 15:14:56 user nova-compute[70645]: DEBUG nova.compute.manager [req-1f912efa-a320-40a7-8538-e415b4c5a6a8 req-d6f93c4b-d835-4b2e-aa2f-9660a5a518c0 service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-deleted-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:14:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:56 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Deleted allocations for instance 74c53188-2399-4515-94e6-4ff3e94d7559
Jul 24 15:14:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6b0fd5ed-a19e-473f-b74a-14806763fcb9 tempest-ServerRescueNegativeTestJSON-1652524619 tempest-ServerRescueNegativeTestJSON-1652524619-project-member] Lock "74c53188-2399-4515-94e6-4ff3e94d7559" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.577s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-8313a3a4-6df0-4294-9b78-82fd7e8c5b65 req-43dce046-bdbb-4699-9265-8ced35a14a6f service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:14:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8313a3a4-6df0-4294-9b78-82fd7e8c5b65 req-43dce046-bdbb-4699-9265-8ced35a14a6f service nova] Acquiring lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:14:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8313a3a4-6df0-4294-9b78-82fd7e8c5b65 req-43dce046-bdbb-4699-9265-8ced35a14a6f service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:14:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8313a3a4-6df0-4294-9b78-82fd7e8c5b65 req-43dce046-bdbb-4699-9265-8ced35a14a6f service nova] Lock "74c53188-2399-4515-94e6-4ff3e94d7559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:14:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-8313a3a4-6df0-4294-9b78-82fd7e8c5b65 req-43dce046-bdbb-4699-9265-8ced35a14a6f service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] No waiting events found dispatching network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:14:57 user nova-compute[70645]: WARNING nova.compute.manager [req-8313a3a4-6df0-4294-9b78-82fd7e8c5b65 req-43dce046-bdbb-4699-9265-8ced35a14a6f service nova] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Received unexpected event network-vif-plugged-a4da7fd3-4861-41a6-ad8c-d9326d1b7160 for instance with vm_state deleted and task_state None.
Jul 24 15:15:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG nova.compute.manager [req-ac09c422-f1e0-41ec-89e3-557d5c0c7cc4 req-536afdee-490e-4b07-b717-6313b89d64b6 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-changed-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG nova.compute.manager [req-ac09c422-f1e0-41ec-89e3-557d5c0c7cc4 req-536afdee-490e-4b07-b717-6313b89d64b6 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Refreshing instance network info cache due to event network-changed-33997fc3-0a55-4ace-8e42-d1d57ae5f66f. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ac09c422-f1e0-41ec-89e3-557d5c0c7cc4 req-536afdee-490e-4b07-b717-6313b89d64b6 service nova] Acquiring lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ac09c422-f1e0-41ec-89e3-557d5c0c7cc4 req-536afdee-490e-4b07-b717-6313b89d64b6 service nova] Acquired lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG nova.network.neutron [req-ac09c422-f1e0-41ec-89e3-557d5c0c7cc4 req-536afdee-490e-4b07-b717-6313b89d64b6 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Refreshing network info cache for port 33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:08 user nova-compute[70645]: INFO nova.compute.manager [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Terminating instance
Jul 24 15:15:08 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG nova.network.neutron [req-ac09c422-f1e0-41ec-89e3-557d5c0c7cc4 req-536afdee-490e-4b07-b717-6313b89d64b6 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updated VIF entry in instance network info cache for port 33997fc3-0a55-4ace-8e42-d1d57ae5f66f. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG nova.network.neutron [req-ac09c422-f1e0-41ec-89e3-557d5c0c7cc4 req-536afdee-490e-4b07-b717-6313b89d64b6 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating instance_info_cache with network_info: [{"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ac09c422-f1e0-41ec-89e3-557d5c0c7cc4 req-536afdee-490e-4b07-b717-6313b89d64b6 service nova] Releasing lock "refresh_cache-012bb476-47bc-4bfc-96aa-c53fe1d7de6e" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:15:09 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Instance destroyed successfully.
Jul 24 15:15:09 user nova-compute[70645]: DEBUG nova.objects.instance [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lazy-loading 'resources' on Instance uuid 012bb476-47bc-4bfc-96aa-c53fe1d7de6e {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T15:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1065436731',display_name='tempest-TestShelveInstance-server-1065436731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1065436731',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRi8VGO3j6KnekRSs2bYS3PuYQyHaFasE9r8zCC1CvdS8fQqrYI4K3kKProSoPH3NKf0nIsY/OWOnRSUw25COR+NZrS6VpiPyJSwm2iFgvZQVGXw/yH+aAoqsabm3Ukg==',key_name='tempest-TestShelveInstance-1650283485',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:13:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2680ac44b8394d5c8e1b086884cb61f1',ramdisk_id='',reservation_id='r-j0ksgdvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2062206678',owner_user_name='tempest-TestShelveInstance-2062206678-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:13:33Z,user_data=None,user_id='6a73120d16244c85b13ec468bca3c982',uuid=012bb476-47bc-4bfc-96aa-c53fe1d7de6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converting VIF {"id": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "address": "fa:16:3e:c6:84:18", "network": {"id": "432febb3-bf8b-4d21-882e-66c17794f5a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-587726170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2680ac44b8394d5c8e1b086884cb61f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33997fc3-0a", "ovs_interfaceid": "33997fc3-0a55-4ace-8e42-d1d57ae5f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_vif [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33997fc3-0a, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:15:09 user nova-compute[70645]: INFO os_vif [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:84:18,bridge_name='br-int',has_traffic_filtering=True,id=33997fc3-0a55-4ace-8e42-d1d57ae5f66f,network=Network(432febb3-bf8b-4d21-882e-66c17794f5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33997fc3-0a')
Jul 24 15:15:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoxSDjbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:15:09 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c44620-0098-4549-8372-f0b0d6b9d08b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce3e7a5-b930-464e-841d-9119474f8eaa]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:15:09 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe (non-flash)
Jul 24 15:15:09 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba941a4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0fdde0-c0b7-4b17-ab5f-b1bb9166b094]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[307d288e-a501-42f6-8523-1220614d96b0]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d804a1cb-701f-4c56-ba23-b8321f502ab0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb230e4-149d-42ff-be85-1ce9a77a82a0]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOaeb827d-df6d24ed053d1c2c', '/dev/disk/by-id/scsi-26466366432346564', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_aeb827d') {{(pid=81509) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a3613a-4146-400a-93f7-9a382c7a07b3]: (4, None) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a7f467-669e-45ea-8917-829ed8c2154b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cd69fb-09cb-468e-ad1d-1272c3c19425]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260]
Jul 24 15:15:09 user nova-compute[70645]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe, portal: 172.16.0.220,3260] successful.
Jul 24 15:15:09 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d287b2a0-2700-4b84-8cc5-4ba3e83faffe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea459ac-4e3a-4dbf-92ee-50cde46086c1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] <== disconnect_volume: return (267ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:15:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:15:09 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Deleting instance files /opt/stack/data/nova/instances/012bb476-47bc-4bfc-96aa-c53fe1d7de6e_del
Jul 24 15:15:09 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Deletion of /opt/stack/data/nova/instances/012bb476-47bc-4bfc-96aa-c53fe1d7de6e_del complete
Jul 24 15:15:10 user nova-compute[70645]: INFO nova.compute.manager [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Took 1.25 seconds to destroy the instance on the hypervisor.
Jul 24 15:15:10 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:15:10 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Took 0.45 seconds to deallocate network for instance.
Jul 24 15:15:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-f1f43b88-8971-41ec-a543-7cef13a1e2c5 req-2aeedb5f-aaa0-48c0-8e5d-87de3b9087a3 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-vif-deleted-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-vif-unplugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] No waiting events found dispatching network-vif-unplugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-vif-unplugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] Acquiring lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] No waiting events found dispatching network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:15:10 user nova-compute[70645]: WARNING nova.compute.manager [req-7b501128-ea1f-4225-bdf4-b1ffddd32f08 req-9922147e-201b-4a37-9a2e-393cf5a76eb7 service nova] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Received unexpected event network-vif-plugged-33997fc3-0a55-4ace-8e42-d1d57ae5f66f for instance with vm_state active and task_state deleting.
Jul 24 15:15:10 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211695.975204, 74c53188-2399-4515-94e6-4ff3e94d7559 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:15:10 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] VM Stopped (Lifecycle Event)
Jul 24 15:15:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:10 user nova-compute[70645]: DEBUG nova.compute.manager [None req-89a19181-6e56-4f22-b29f-92a5046b8619 None None] [instance: 74c53188-2399-4515-94e6-4ff3e94d7559] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:15:11 user nova-compute[70645]: INFO nova.compute.manager [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Took 0.74 seconds to detach 1 volumes for instance.
Jul 24 15:15:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Deleting volume: d287b2a0-2700-4b84-8cc5-4ba3e83faffe {{(pid=70645) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 15:15:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:11 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:15:11 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:15:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:11 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Deleted allocations for instance 012bb476-47bc-4bfc-96aa-c53fe1d7de6e
Jul 24 15:15:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ea82afba-3e69-459f-ae50-928151b52dc9 tempest-TestShelveInstance-2062206678 tempest-TestShelveInstance-2062206678-project-member] Lock "012bb476-47bc-4bfc-96aa-c53fe1d7de6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.924s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:15:24 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211709.6243236, 012bb476-47bc-4bfc-96aa-c53fe1d7de6e => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:15:24 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] VM Stopped (Lifecycle Event)
Jul 24 15:15:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:15:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:15:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:15:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:15:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-5686f92a-150d-4f22-b3b9-c93ddd8c0f65 None None] [instance: 012bb476-47bc-4bfc-96aa-c53fe1d7de6e] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:15:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:28 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'flavor' on Instance uuid 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:28 user nova-compute[70645]: INFO nova.compute.manager [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Attaching volume e27149c3-1502-46ae-bcdd-54061e931cff to /dev/vdb
Jul 24 15:15:29 user nova-compute[70645]: DEBUG os_brick.utils [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[811b776a-736e-48d3-84d8-5c7f81e20b73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e831fee3-0935-4fdf-99ec-c80e5cff6ccb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a32c1c-42b9-4fe9-9177-bf3058b946a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf6a40c-1ed7-406b-abb2-dbac3e29fd4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:15:29 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:15:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a330f86d-ba1e-4f4d-b2e2-36f549c37c34]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG os_brick.utils [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updating existing volume attachment record: 61d38f7c-5805-486f-9249-0d09ee61d272 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:15:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:15:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:15:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:15:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:15:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:32 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:34 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:15:34 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:15:34 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8221MB free_disk=25.36007308959961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 1372f999-32a0-4079-ab57-597093017d8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 47016839-ba35-418a-af61-d2b9ed1ffccc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 936cb284-e0df-4640-ad6a-9719d334a26c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance c71a9a04-efaf-4cdf-b494-d84412030cbf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:15:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:15:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updating instance_info_cache with network_info: [{"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-62769fa7-a219-434d-a3bd-223e14419ed9 req-0414f654-d6b4-4d6c-b16c-8880e9df27b4 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received event network-changed-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-62769fa7-a219-434d-a3bd-223e14419ed9 req-0414f654-d6b4-4d6c-b16c-8880e9df27b4 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Refreshing instance network info cache due to event network-changed-5987a4b3-b4ae-472d-b509-1f527b9c64e7. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-62769fa7-a219-434d-a3bd-223e14419ed9 req-0414f654-d6b4-4d6c-b16c-8880e9df27b4 service nova] Acquiring lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-62769fa7-a219-434d-a3bd-223e14419ed9 req-0414f654-d6b4-4d6c-b16c-8880e9df27b4 service nova] Acquired lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG nova.network.neutron [req-62769fa7-a219-434d-a3bd-223e14419ed9 req-0414f654-d6b4-4d6c-b16c-8880e9df27b4 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Refreshing network info cache for port 5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:15:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "47016839-ba35-418a-af61-d2b9ed1ffccc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-62769fa7-a219-434d-a3bd-223e14419ed9 req-0414f654-d6b4-4d6c-b16c-8880e9df27b4 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updated VIF entry in instance network info cache for port 5987a4b3-b4ae-472d-b509-1f527b9c64e7. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-62769fa7-a219-434d-a3bd-223e14419ed9 req-0414f654-d6b4-4d6c-b16c-8880e9df27b4 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updating instance_info_cache with network_info: [{"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG nova.objects.instance [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'flavor' on Instance uuid 47016839-ba35-418a-af61-d2b9ed1ffccc {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-62769fa7-a219-434d-a3bd-223e14419ed9 req-0414f654-d6b4-4d6c-b16c-8880e9df27b4 service nova] Releasing lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "47016839-ba35-418a-af61-d2b9ed1ffccc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:37 user nova-compute[70645]: INFO nova.compute.manager [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Attaching volume dcd5aced-2bfc-493d-8a18-71fd74838e04 to /dev/vdb
Jul 24 15:15:37 user nova-compute[70645]: DEBUG os_brick.utils [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6780971d-31e5-4222-a4c0-75ccd5ebca5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac93545d-87f4-4d28-abae-ace446ebde3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[963fd07e-4b7a-41ae-990a-fa93ec7b319a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[08022971-374f-4b6c-bb88-a7e8db2c0585]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:15:37 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:15:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[437cf768-d97e-4c4e-b7c8-1869a1d78c8b]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG os_brick.utils [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:15:37 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updating existing volume attachment record: fa66c68f-1036-46fc-9fb7-05bd61adf813 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpySzdJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:15:38 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:15:38 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:15:38 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c080bdbb-6e16-40d5-9976-012499defc41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:15:38 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3359ac-b189-4323-8ce6-08b1b49629bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff] added
Jul 24 15:15:38 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[57feaef8-10e9-4b21-b0a4-50b96cf17afb]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca6c537-6490-40b0-9d43-2c3feed8cd9d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpySzdJx {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpySzdJx" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[530388a7-a934-4335-98b0-b4ee46b599c1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BpySzdJx'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede8636d-173e-4527-b4c9-69373f9cc988]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f749843-a3f0-48cd-8f80-962e944cd8b4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:15:38 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:15:38 user nova-compute[70645]:  {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:15:38 user nova-compute[70645]: WARNING os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 15:15:38 user nova-compute[70645]: 
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfa500e-1ac8-4037-b1fb-a7d0d48eaaec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260]
Jul 24 15:15:38 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260] successful.
Jul 24 15:15:38 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae828282-ca3a-4c7c-b93b-7225b55da295]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9ae65d-6ffe-4049-85fa-699a07e8987e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:38 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:38 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.039s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[db82c7b4-2c06-4af1-bc84-81895d8a801e]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:15:38 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpySzdJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26462353739393264', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462353739393264', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'flavor' on Instance uuid 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:15:39 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:15:39 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:15:39 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:15:39 user nova-compute[70645]:   <serial>e27149c3-1502-46ae-bcdd-54061e931cff</serial>
Jul 24 15:15:39 user nova-compute[70645]: </disk>
Jul 24 15:15:39 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] No VIF found with MAC fa:16:3e:ce:ee:14, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:15:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f3f59bf-fcad-4272-b06a-6bf843a6fde8 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.979s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:40 user nova-compute[70645]: DEBUG nova.compute.manager [req-d1341791-8628-43ee-a328-0a4fa0069aa7 req-e4096730-3a7d-42f2-89b1-21cb6f47632f service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Received event network-changed-b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:40 user nova-compute[70645]: DEBUG nova.compute.manager [req-d1341791-8628-43ee-a328-0a4fa0069aa7 req-e4096730-3a7d-42f2-89b1-21cb6f47632f service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Refreshing instance network info cache due to event network-changed-b3256b72-7d12-4211-af7c-8c3309af4b3b. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:15:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d1341791-8628-43ee-a328-0a4fa0069aa7 req-e4096730-3a7d-42f2-89b1-21cb6f47632f service nova] Acquiring lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:15:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d1341791-8628-43ee-a328-0a4fa0069aa7 req-e4096730-3a7d-42f2-89b1-21cb6f47632f service nova] Acquired lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:15:40 user nova-compute[70645]: DEBUG nova.network.neutron [req-d1341791-8628-43ee-a328-0a4fa0069aa7 req-e4096730-3a7d-42f2-89b1-21cb6f47632f service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Refreshing network info cache for port b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:15:40 user nova-compute[70645]: DEBUG nova.network.neutron [req-d1341791-8628-43ee-a328-0a4fa0069aa7 req-e4096730-3a7d-42f2-89b1-21cb6f47632f service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Updated VIF entry in instance network info cache for port b3256b72-7d12-4211-af7c-8c3309af4b3b. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:15:40 user nova-compute[70645]: DEBUG nova.network.neutron [req-d1341791-8628-43ee-a328-0a4fa0069aa7 req-e4096730-3a7d-42f2-89b1-21cb6f47632f service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Updating instance_info_cache with network_info: [{"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:15:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d1341791-8628-43ee-a328-0a4fa0069aa7 req-e4096730-3a7d-42f2-89b1-21cb6f47632f service nova] Releasing lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:15:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqwYdVtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:15:44 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:15:44 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:15:44 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[196a7ed4-9acb-4f7d-bed3-1bb0d0799f73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:15:44 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc8ece1-1b3b-40fc-a046-f6039170af87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04] added
Jul 24 15:15:44 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7585c9-b86e-4451-aced-1f6744962769]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfbaa2b-ea66-423f-a66c-2b5a8070f37c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZqwYdVtT {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZqwYdVtT" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c4e950-d815-474b-847a-063f11a80e6a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZqwYdVtT'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a314cf4-8165-4c1f-846c-0826c2a4b23c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "936cb284-e0df-4640-ad6a-9719d334a26c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fc7a8a-30e7-4abe-938f-968233b9ecbb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:44 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:44 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG nova.objects.instance [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'flavor' on Instance uuid 936cb284-e0df-4640-ad6a-9719d334a26c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f45ca6-7656-4a10-9e51-8f6b44c1a0ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04, portal: 172.16.0.220,3260]
Jul 24 15:15:44 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04, portal: 172.16.0.220,3260] successful.
Jul 24 15:15:44 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[768a2761-fe11-43c1-9cd9-e2e8cc62b3a0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35d54c1-7223-4320-817f-ae3487577714]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:44 user nova-compute[70645]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 (non-flash)
Jul 24 15:15:44 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:44 user nova-compute[70645]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 (non-flash)
Jul 24 15:15:44 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c2bb31-ddef-4b39-8656-dfdba047e8ec]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "936cb284-e0df-4640-ad6a-9719d334a26c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:44 user nova-compute[70645]: INFO nova.compute.manager [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Attaching volume 215bf4f9-db4a-470c-b979-ddb7844036f8 to /dev/vdb
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.utils [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51847e9-4ddf-4dd1-b0ad-fd1be7847849]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c74eff-b37f-42b8-988e-20339327e809]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d9cbd-6478-4549-ad18-c819d90ebac4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7455ab-e2fe-49c0-84b9-7dc667fcfa48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:15:44 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:15:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9333ad93-73ba-42a8-b711-45cac5bf74a7]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG os_brick.utils [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Updating existing volume attachment record: 3939c0e6-fa7e-4848-abb0-820fe51a1e52 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:15:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:45 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:15:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqwYdVtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:15:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:15:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26333613934363234', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:15:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333613934363234', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:15:45 user nova-compute[70645]: DEBUG nova.objects.instance [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'flavor' on Instance uuid 47016839-ba35-418a-af61-d2b9ed1ffccc {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:15:45 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:15:45 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:15:45 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:15:45 user nova-compute[70645]:   <serial>dcd5aced-2bfc-493d-8a18-71fd74838e04</serial>
Jul 24 15:15:45 user nova-compute[70645]: </disk>
Jul 24 15:15:45 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:15:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:15:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:15:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] No VIF found with MAC fa:16:3e:7c:c5:ee, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:15:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-06db4fab-f8ea-46c3-b0be-1d0fe0c850f9 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.512s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:46 user nova-compute[70645]: DEBUG nova.compute.manager [req-24655935-8fbc-4e07-b07b-32af81aac57b req-33f4b48e-50cf-49cf-8701-adb9585f117a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-changed-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:46 user nova-compute[70645]: DEBUG nova.compute.manager [req-24655935-8fbc-4e07-b07b-32af81aac57b req-33f4b48e-50cf-49cf-8701-adb9585f117a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Refreshing instance network info cache due to event network-changed-4dee8450-99dd-4a74-b710-6760a5a94e79. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:15:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-24655935-8fbc-4e07-b07b-32af81aac57b req-33f4b48e-50cf-49cf-8701-adb9585f117a service nova] Acquiring lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:15:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-24655935-8fbc-4e07-b07b-32af81aac57b req-33f4b48e-50cf-49cf-8701-adb9585f117a service nova] Acquired lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:15:46 user nova-compute[70645]: DEBUG nova.network.neutron [req-24655935-8fbc-4e07-b07b-32af81aac57b req-33f4b48e-50cf-49cf-8701-adb9585f117a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Refreshing network info cache for port 4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:15:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-24655935-8fbc-4e07-b07b-32af81aac57b req-33f4b48e-50cf-49cf-8701-adb9585f117a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updated VIF entry in instance network info cache for port 4dee8450-99dd-4a74-b710-6760a5a94e79. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:15:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-24655935-8fbc-4e07-b07b-32af81aac57b req-33f4b48e-50cf-49cf-8701-adb9585f117a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updating instance_info_cache with network_info: [{"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:15:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-24655935-8fbc-4e07-b07b-32af81aac57b req-33f4b48e-50cf-49cf-8701-adb9585f117a service nova] Releasing lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:15:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "47016839-ba35-418a-af61-d2b9ed1ffccc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:47 user nova-compute[70645]: INFO nova.compute.manager [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Detaching volume dcd5aced-2bfc-493d-8a18-71fd74838e04
Jul 24 15:15:47 user nova-compute[70645]: INFO nova.virt.block_device [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Attempting to driver detach volume dcd5aced-2bfc-493d-8a18-71fd74838e04 from mountpoint /dev/vdb
Jul 24 15:15:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Attempting to detach device vdb from instance 47016839-ba35-418a-af61-d2b9ed1ffccc from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:15:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:15:47 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:15:47 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:15:47 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:15:47 user nova-compute[70645]:   <serial>dcd5aced-2bfc-493d-8a18-71fd74838e04</serial>
Jul 24 15:15:47 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:15:47 user nova-compute[70645]: </disk>
Jul 24 15:15:47 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:15:47 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Successfully detached device vdb from instance 47016839-ba35-418a-af61-d2b9ed1ffccc from the persistent domain config.
Jul 24 15:15:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47016839-ba35-418a-af61-d2b9ed1ffccc from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:15:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:15:47 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:15:47 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:15:47 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:15:47 user nova-compute[70645]:   <serial>dcd5aced-2bfc-493d-8a18-71fd74838e04</serial>
Jul 24 15:15:47 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:15:47 user nova-compute[70645]: </disk>
Jul 24 15:15:47 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211748.2508674, 47016839-ba35-418a-af61-d2b9ed1ffccc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47016839-ba35-418a-af61-d2b9ed1ffccc {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:15:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Successfully detached device vdb from instance 47016839-ba35-418a-af61-d2b9ed1ffccc from the live domain config.
Jul 24 15:15:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqwYdVtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:15:48 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc5ae8a-379c-4f08-b8c3-a346de7bd154]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3ec01b-2c16-4967-b59d-c75b9dca9013]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:48 user nova-compute[70645]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 (non-flash)
Jul 24 15:15:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:48 user nova-compute[70645]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 (non-flash)
Jul 24 15:15:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba840fce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d3af4a-6f10-4410-886f-3758ff52c56e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a986a5-3efa-4371-b5bc-30158a06487b]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3378ff8e-da5a-4ad4-8129-5e0573771eba]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b663e2-a1ed-4b58-9cb9-f3754b8d5355]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba14050-eb8e-4013-9fa9-5344399c5081]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[44428bf9-45c0-49b1-8706-bf0c36cb4fb0]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04, portal: 172.16.0.220,3260]
Jul 24 15:15:48 user nova-compute[70645]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04, portal: 172.16.0.220,3260] successful.
Jul 24 15:15:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd5aced-2bfc-493d-8a18-71fd74838e04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[022f82bd-34ff-4f73-aca2-68ae34f1b4b7]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] <== disconnect_volume: return (312ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:15:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8945e9e-ff07-442b-ae40-f6b92746476c req-5afb5104-225e-45c6-866d-9599a1db84ae service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-changed-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-d8945e9e-ff07-442b-ae40-f6b92746476c req-5afb5104-225e-45c6-866d-9599a1db84ae service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Refreshing instance network info cache due to event network-changed-4dee8450-99dd-4a74-b710-6760a5a94e79. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8945e9e-ff07-442b-ae40-f6b92746476c req-5afb5104-225e-45c6-866d-9599a1db84ae service nova] Acquiring lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8945e9e-ff07-442b-ae40-f6b92746476c req-5afb5104-225e-45c6-866d-9599a1db84ae service nova] Acquired lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-d8945e9e-ff07-442b-ae40-f6b92746476c req-5afb5104-225e-45c6-866d-9599a1db84ae service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Refreshing network info cache for port 4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG nova.objects.instance [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'flavor' on Instance uuid 47016839-ba35-418a-af61-d2b9ed1ffccc {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-961afc08-4d1d-4ea1-aaa9-5c497162f3dd tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.779s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-d8945e9e-ff07-442b-ae40-f6b92746476c req-5afb5104-225e-45c6-866d-9599a1db84ae service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updated VIF entry in instance network info cache for port 4dee8450-99dd-4a74-b710-6760a5a94e79. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-d8945e9e-ff07-442b-ae40-f6b92746476c req-5afb5104-225e-45c6-866d-9599a1db84ae service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updating instance_info_cache with network_info: [{"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:15:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d8945e9e-ff07-442b-ae40-f6b92746476c req-5afb5104-225e-45c6-866d-9599a1db84ae service nova] Releasing lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:15:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Acquiring lock "c71a9a04-efaf-4cdf-b494-d84412030cbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Acquiring lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:50 user nova-compute[70645]: INFO nova.compute.manager [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Terminating instance
Jul 24 15:15:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:15:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-0d2d3af2-5be3-463a-8e2a-cce9fe46d979 req-a2bd5a03-c460-4545-be83-1729a8d8dc04 service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Received event network-vif-unplugged-82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0d2d3af2-5be3-463a-8e2a-cce9fe46d979 req-a2bd5a03-c460-4545-be83-1729a8d8dc04 service nova] Acquiring lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0d2d3af2-5be3-463a-8e2a-cce9fe46d979 req-a2bd5a03-c460-4545-be83-1729a8d8dc04 service nova] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0d2d3af2-5be3-463a-8e2a-cce9fe46d979 req-a2bd5a03-c460-4545-be83-1729a8d8dc04 service nova] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-0d2d3af2-5be3-463a-8e2a-cce9fe46d979 req-a2bd5a03-c460-4545-be83-1729a8d8dc04 service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] No waiting events found dispatching network-vif-unplugged-82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-0d2d3af2-5be3-463a-8e2a-cce9fe46d979 req-a2bd5a03-c460-4545-be83-1729a8d8dc04 service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Received event network-vif-unplugged-82146887-3639-4df8-a4f6-297b76202ac8 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:15:51 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Instance destroyed successfully.
Jul 24 15:15:51 user nova-compute[70645]: DEBUG nova.objects.instance [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lazy-loading 'resources' on Instance uuid c71a9a04-efaf-4cdf-b494-d84412030cbf {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1230455807',display_name='tempest-VolumesNegativeTest-instance-1230455807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1230455807',id=39,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:14:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d121c171b01f41258fa98bbca07d3b63',ramdisk_id='',reservation_id='r-dep0spe7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-798127368',owner_user_name='tempest-VolumesNegativeTest-798127368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:14:09Z,user_data=None,user_id='ef4ab3cfe7154e23b207a91fbfc0f098',uuid=c71a9a04-efaf-4cdf-b494-d84412030cbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82146887-3639-4df8-a4f6-297b76202ac8", "address": "fa:16:3e:75:56:02", "network": {"id": "bcbfafb1-3c65-47e9-9058-32fd5a3225f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b65d0636576c475486adf5aa6fbed00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82146887-36", "ovs_interfaceid": "82146887-3639-4df8-a4f6-297b76202ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Converting VIF {"id": "82146887-3639-4df8-a4f6-297b76202ac8", "address": "fa:16:3e:75:56:02", "network": {"id": "bcbfafb1-3c65-47e9-9058-32fd5a3225f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b65d0636576c475486adf5aa6fbed00f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82146887-36", "ovs_interfaceid": "82146887-3639-4df8-a4f6-297b76202ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:56:02,bridge_name='br-int',has_traffic_filtering=True,id=82146887-3639-4df8-a4f6-297b76202ac8,network=Network(bcbfafb1-3c65-47e9-9058-32fd5a3225f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82146887-36') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_vif [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:56:02,bridge_name='br-int',has_traffic_filtering=True,id=82146887-3639-4df8-a4f6-297b76202ac8,network=Network(bcbfafb1-3c65-47e9-9058-32fd5a3225f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82146887-36') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82146887-36, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:51 user nova-compute[70645]: INFO os_vif [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:56:02,bridge_name='br-int',has_traffic_filtering=True,id=82146887-3639-4df8-a4f6-297b76202ac8,network=Network(bcbfafb1-3c65-47e9-9058-32fd5a3225f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82146887-36')
Jul 24 15:15:51 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Deleting instance files /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf_del
Jul 24 15:15:51 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Deletion of /opt/stack/data/nova/instances/c71a9a04-efaf-4cdf-b494-d84412030cbf_del complete
Jul 24 15:15:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CngHrKlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:15:51 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:15:51 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:15:51 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:51 user nova-compute[70645]: INFO nova.compute.manager [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Took 0.72 seconds to destroy the instance on the hypervisor.
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e9b94-df8f-4605-8ab4-7ec50846f13f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:15:51 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a178534-0d23-47f5-ad51-f36e5bc3a4b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8] added
Jul 24 15:15:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a17a4f9-52d8-4f02-84a3-0fd08ae415d7]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2a173e-60a2-4ff7-9cde-5a3caf1d5314]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CngHrKlm {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CngHrKlm" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22502dd-c0ef-4a13-aa3a-ecaec19d7e6b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CngHrKlm'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bce8ad-8873-4cc1-a2c3-ccc6ca1b4910]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[585b1e18-c1b5-4622-ad51-7119899df7b2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7375f022-9042-4081-be1a-14dde968b93c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8, portal: 172.16.0.220,3260]
Jul 24 15:15:51 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8, portal: 172.16.0.220,3260] successful.
Jul 24 15:15:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ded729-7a3f-4db2-b2f1-32e2b9f3e646]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8e866f-358b-4874-99ed-b8ea658b2838]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:51 user nova-compute[70645]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:15:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:51 user nova-compute[70645]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:15:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d03837-f3d5-4248-bd0d-e40c98af1bef]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:15:52 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Took 0.49 seconds to deallocate network for instance.
Jul 24 15:15:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-96c42f91-d2bb-4ec8-98c1-13ee27301d79 req-a8124d9c-782c-4b9d-8da2-83b71177f90d service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Received event network-vif-deleted-82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:52 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Deleted allocations for instance c71a9a04-efaf-4cdf-b494-d84412030cbf
Jul 24 15:15:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3e10bf58-d02e-4ec7-bcdc-f6cc5e1949ec tempest-VolumesNegativeTest-798127368 tempest-VolumesNegativeTest-798127368-project-member] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.639s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CngHrKlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26638653531323138', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638653531323138', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG nova.objects.instance [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'flavor' on Instance uuid 936cb284-e0df-4640-ad6a-9719d334a26c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:15:52 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:15:52 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:15:52 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:15:52 user nova-compute[70645]:   <serial>215bf4f9-db4a-470c-b979-ddb7844036f8</serial>
Jul 24 15:15:52 user nova-compute[70645]: </disk>
Jul 24 15:15:52 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-a0e4bf48-d993-49b6-a2a7-bc81ccb25388 req-460c1cfb-c264-4a9c-95ff-89af319e6b0f service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Received event network-vif-plugged-82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a0e4bf48-d993-49b6-a2a7-bc81ccb25388 req-460c1cfb-c264-4a9c-95ff-89af319e6b0f service nova] Acquiring lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a0e4bf48-d993-49b6-a2a7-bc81ccb25388 req-460c1cfb-c264-4a9c-95ff-89af319e6b0f service nova] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a0e4bf48-d993-49b6-a2a7-bc81ccb25388 req-460c1cfb-c264-4a9c-95ff-89af319e6b0f service nova] Lock "c71a9a04-efaf-4cdf-b494-d84412030cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-a0e4bf48-d993-49b6-a2a7-bc81ccb25388 req-460c1cfb-c264-4a9c-95ff-89af319e6b0f service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] No waiting events found dispatching network-vif-plugged-82146887-3639-4df8-a4f6-297b76202ac8 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:15:53 user nova-compute[70645]: WARNING nova.compute.manager [req-a0e4bf48-d993-49b6-a2a7-bc81ccb25388 req-460c1cfb-c264-4a9c-95ff-89af319e6b0f service nova] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Received unexpected event network-vif-plugged-82146887-3639-4df8-a4f6-297b76202ac8 for instance with vm_state deleted and task_state None.
Jul 24 15:15:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No VIF found with MAC fa:16:3e:68:d7:02, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:53 user nova-compute[70645]: INFO nova.compute.manager [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Rebooting instance
Jul 24 15:15:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquired lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-eef0102a-c7ef-425d-9302-bfd3197c0edf tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.069s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updating instance_info_cache with network_info: [{"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Releasing lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:15:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-47f1685e-b4d9-4ffd-9805-1a4348b6d77a req-8bbd8c17-46fb-427d-bd71-9367f16fa20a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-unplugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-47f1685e-b4d9-4ffd-9805-1a4348b6d77a req-8bbd8c17-46fb-427d-bd71-9367f16fa20a service nova] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-47f1685e-b4d9-4ffd-9805-1a4348b6d77a req-8bbd8c17-46fb-427d-bd71-9367f16fa20a service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-47f1685e-b4d9-4ffd-9805-1a4348b6d77a req-8bbd8c17-46fb-427d-bd71-9367f16fa20a service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG nova.compute.manager [req-47f1685e-b4d9-4ffd-9805-1a4348b6d77a req-8bbd8c17-46fb-427d-bd71-9367f16fa20a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] No waiting events found dispatching network-vif-unplugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:15:54 user nova-compute[70645]: WARNING nova.compute.manager [req-47f1685e-b4d9-4ffd-9805-1a4348b6d77a req-8bbd8c17-46fb-427d-bd71-9367f16fa20a service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received unexpected event network-vif-unplugged-4dee8450-99dd-4a74-b710-6760a5a94e79 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 15:15:54 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Instance destroyed successfully.
Jul 24 15:15:54 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'resources' on Instance uuid 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-424672047',display_name='tempest-TestMinimumBasicScenario-server-424672047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-424672047',id=36,image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMCo6QZiJchQhXRrPHIyCnOnnbjhZeUgUNG+32wdjxCdvlCaRVoEBgBdjGF7809Qm8W4trKXOzuU4MYrdfJ22pUeuIEmUyKnM5PXOk3q1rOao/NPluVjCFlULEzSwPC6Q==',key_name='tempest-TestMinimumBasicScenario-976160831',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:13:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2699829f2bd4b638132ea38a8f28b13',ramdisk_id='',reservation_id='r-81kts241',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-55837010',owner_user_name='tempest-TestMinimumBasicScenario-55837010-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:15:54Z,user_data=None,user_id='782bcf41be0f4fcf881d467649ef5206',uuid=1372f999-32a0-4079-ab57-597093017d8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converting VIF {"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG os_vif [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dee8450-99, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:15:54 user nova-compute[70645]: INFO os_vif [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99')
Jul 24 15:15:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpySzdJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:15:54 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:15:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e835d9-ee2e-4377-affb-9635c795b3e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d83fda8-69ea-4cab-9932-1b59bb942bfa]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:54 user nova-compute[70645]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:15:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:54 user nova-compute[70645]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:15:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbaa1ccb5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:15:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e90855a-f497-40c0-9b01-69f1e7c5fbf8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fadd4aa-61f0-4666-8d87-62c65d5fb86f]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[47879e8a-9e48-4e1c-9703-f1f421d05e78]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f796c96-f248-4bc3-b0cc-817ca553a926]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9e42fe-0bb6-4b23-9270-a7e7ab49fbe5]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a981a5-5a31-4bc7-bff5-da1353da070a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260]
Jul 24 15:15:55 user nova-compute[70645]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260] successful.
Jul 24 15:15:55 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44f1e7d-031d-4eb3-8cb8-20e1d6370bbc]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] <== disconnect_volume: return (301ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Start _get_guest_xml network_info=[{"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3135bff3-0df2-4a5e-ab94-eb5dd2f182b2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': '3135bff3-0df2-4a5e-ab94-eb5dd2f182b2'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '61d38f7c-5805-486f-9249-0d09ee61d272', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpySzdJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1372f999-32a0-4079-ab57-597093017d8b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e27149c3-1502-46ae-bcdd-54061e931cff', 'serial': 'e27149c3-1502-46ae-bcdd-54061e931cff'}, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:15:55 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:15:55 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3135bff3-0df2-4a5e-ab94-eb5dd2f182b2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpySzdJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:15:55 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:15:55 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:15:55 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a4042-b4b4-4931-9d83-3ecca152999e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:15:55 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b994860-f972-4b1a-959b-2c00d31dcb99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff] added
Jul 24 15:15:55 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f13317-23f8-4517-8615-f443db958346]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1797712-a92c-4fe5-a856-5dc90b0ea64a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpySzdJx {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpySzdJx" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb99fb2a-e5f7-49d3-afcc-7c4406f70fcd]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BpySzdJx'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[015f739d-7e24-41b3-83c7-6242fe5c7fba]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf4adad-deec-4b38-bbce-d9f686992bd2]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:15:55 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:15:55 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaa0438-f747-40e2-b2b8-551c7024ce86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260]
Jul 24 15:15:55 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260] successful.
Jul 24 15:15:55 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a26b0cf-1167-4030-92c2-caac0259028a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dd37e6-028b-4f48-b5a0-451fb4605730]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:15:55 user nova-compute[70645]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:55 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:15:55 user nova-compute[70645]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:15:55 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3f38c9-0f76-48d7-b631-cc0a2471756b]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:15:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpySzdJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26462353739393264', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462353739393264', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-424672047',display_name='tempest-TestMinimumBasicScenario-server-424672047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-424672047',id=36,image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMCo6QZiJchQhXRrPHIyCnOnnbjhZeUgUNG+32wdjxCdvlCaRVoEBgBdjGF7809Qm8W4trKXOzuU4MYrdfJ22pUeuIEmUyKnM5PXOk3q1rOao/NPluVjCFlULEzSwPC6Q==',key_name='tempest-TestMinimumBasicScenario-976160831',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:13:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2699829f2bd4b638132ea38a8f28b13',ramdisk_id='',reservation_id='r-81kts241',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-55837010',owner_user_name='tempest-TestMinimumBasicScenario-55837010-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:15:54Z,user_data=None,user_id='782bcf41be0f4fcf881d467649ef5206',uuid=1372f999-32a0-4079-ab57-597093017d8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converting VIF {"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'pci_devices' on Instance uuid 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:15:56 user nova-compute[70645]:   <uuid>1372f999-32a0-4079-ab57-597093017d8b</uuid>
Jul 24 15:15:56 user nova-compute[70645]:   <name>instance-00000024</name>
Jul 24 15:15:56 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:15:56 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:15:56 user nova-compute[70645]:   <metadata>
Jul 24 15:15:56 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:15:56 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:15:56 user nova-compute[70645]:       <nova:name>tempest-TestMinimumBasicScenario-server-424672047</nova:name>
Jul 24 15:15:56 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:15:55</nova:creationTime>
Jul 24 15:15:56 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:15:56 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:15:56 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:15:56 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:15:56 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:15:56 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:15:56 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:15:56 user nova-compute[70645]:       <nova:owner>
Jul 24 15:15:56 user nova-compute[70645]:         <nova:user uuid="782bcf41be0f4fcf881d467649ef5206">tempest-TestMinimumBasicScenario-55837010-project-member</nova:user>
Jul 24 15:15:56 user nova-compute[70645]:         <nova:project uuid="b2699829f2bd4b638132ea38a8f28b13">tempest-TestMinimumBasicScenario-55837010</nova:project>
Jul 24 15:15:56 user nova-compute[70645]:       </nova:owner>
Jul 24 15:15:56 user nova-compute[70645]:       <nova:root type="image" uuid="3135bff3-0df2-4a5e-ab94-eb5dd2f182b2"/>
Jul 24 15:15:56 user nova-compute[70645]:       <nova:ports>
Jul 24 15:15:56 user nova-compute[70645]:         <nova:port uuid="4dee8450-99dd-4a74-b710-6760a5a94e79">
Jul 24 15:15:56 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 15:15:56 user nova-compute[70645]:         </nova:port>
Jul 24 15:15:56 user nova-compute[70645]:       </nova:ports>
Jul 24 15:15:56 user nova-compute[70645]:     </nova:instance>
Jul 24 15:15:56 user nova-compute[70645]:   </metadata>
Jul 24 15:15:56 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:15:56 user nova-compute[70645]:     <system>
Jul 24 15:15:56 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:15:56 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:15:56 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:15:56 user nova-compute[70645]:       <entry name="serial">1372f999-32a0-4079-ab57-597093017d8b</entry>
Jul 24 15:15:56 user nova-compute[70645]:       <entry name="uuid">1372f999-32a0-4079-ab57-597093017d8b</entry>
Jul 24 15:15:56 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:15:56 user nova-compute[70645]:     </system>
Jul 24 15:15:56 user nova-compute[70645]:   </sysinfo>
Jul 24 15:15:56 user nova-compute[70645]:   <os>
Jul 24 15:15:56 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:15:56 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:15:56 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:15:56 user nova-compute[70645]:   </os>
Jul 24 15:15:56 user nova-compute[70645]:   <features>
Jul 24 15:15:56 user nova-compute[70645]:     <acpi/>
Jul 24 15:15:56 user nova-compute[70645]:     <apic/>
Jul 24 15:15:56 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:15:56 user nova-compute[70645]:   </features>
Jul 24 15:15:56 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:15:56 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:15:56 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:15:56 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:15:56 user nova-compute[70645]:   </clock>
Jul 24 15:15:56 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:15:56 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:15:56 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:15:56 user nova-compute[70645]:   </cpu>
Jul 24 15:15:56 user nova-compute[70645]:   <devices>
Jul 24 15:15:56 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:15:56 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:15:56 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk"/>
Jul 24 15:15:56 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:15:56 user nova-compute[70645]:     </disk>
Jul 24 15:15:56 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:15:56 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:15:56 user nova-compute[70645]:       <source dev="/dev/sdb"/>
Jul 24 15:15:56 user nova-compute[70645]:       <target dev="vdb" bus="virtio"/>
Jul 24 15:15:56 user nova-compute[70645]:       <serial>e27149c3-1502-46ae-bcdd-54061e931cff</serial>
Jul 24 15:15:56 user nova-compute[70645]:     </disk>
Jul 24 15:15:56 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:15:56 user nova-compute[70645]:       <mac address="fa:16:3e:ce:ee:14"/>
Jul 24 15:15:56 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:15:56 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:15:56 user nova-compute[70645]:       <target dev="tap4dee8450-99"/>
Jul 24 15:15:56 user nova-compute[70645]:     </interface>
Jul 24 15:15:56 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:15:56 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/console.log" append="off"/>
Jul 24 15:15:56 user nova-compute[70645]:     </serial>
Jul 24 15:15:56 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:15:56 user nova-compute[70645]:     <video>
Jul 24 15:15:56 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:15:56 user nova-compute[70645]:     </video>
Jul 24 15:15:56 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:15:56 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:15:56 user nova-compute[70645]:     </rng>
Jul 24 15:15:56 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:15:56 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:15:56 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:15:56 user nova-compute[70645]:     </memballoon>
Jul 24 15:15:56 user nova-compute[70645]:   </devices>
Jul 24 15:15:56 user nova-compute[70645]: </domain>
Jul 24 15:15:56 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG nova.compute.manager [req-060c1f53-43a0-40aa-8ba1-011b37fef6f5 req-d2bce0aa-f20f-45c9-80a0-8a1e00b09212 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-060c1f53-43a0-40aa-8ba1-011b37fef6f5 req-d2bce0aa-f20f-45c9-80a0-8a1e00b09212 service nova] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-060c1f53-43a0-40aa-8ba1-011b37fef6f5 req-d2bce0aa-f20f-45c9-80a0-8a1e00b09212 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-060c1f53-43a0-40aa-8ba1-011b37fef6f5 req-d2bce0aa-f20f-45c9-80a0-8a1e00b09212 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG nova.compute.manager [req-060c1f53-43a0-40aa-8ba1-011b37fef6f5 req-d2bce0aa-f20f-45c9-80a0-8a1e00b09212 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] No waiting events found dispatching network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:15:56 user nova-compute[70645]: WARNING nova.compute.manager [req-060c1f53-43a0-40aa-8ba1-011b37fef6f5 req-d2bce0aa-f20f-45c9-80a0-8a1e00b09212 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received unexpected event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 15:15:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb --force-share --output=json" returned: 0 in 0.173s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Cannot resize image /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG nova.objects.instance [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'migration_context' on Instance uuid 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-424672047',display_name='tempest-TestMinimumBasicScenario-server-424672047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-424672047',id=36,image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMCo6QZiJchQhXRrPHIyCnOnnbjhZeUgUNG+32wdjxCdvlCaRVoEBgBdjGF7809Qm8W4trKXOzuU4MYrdfJ22pUeuIEmUyKnM5PXOk3q1rOao/NPluVjCFlULEzSwPC6Q==',key_name='tempest-TestMinimumBasicScenario-976160831',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:13:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b2699829f2bd4b638132ea38a8f28b13',ramdisk_id='',reservation_id='r-81kts241',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-55837010',owner_user_name='tempest-TestMinimumBasicScenario-55837010-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:15:54Z,user_data=None,user_id='782bcf41be0f4fcf881d467649ef5206',uuid=1372f999-32a0-4079-ab57-597093017d8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converting VIF {"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG os_vif [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dee8450-99, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4dee8450-99, col_values=(('external_ids', {'iface-id': '4dee8450-99dd-4a74-b710-6760a5a94e79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ee:14', 'vm-uuid': '1372f999-32a0-4079-ab57-597093017d8b'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:57 user nova-compute[70645]: INFO os_vif [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99')
Jul 24 15:15:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:15:57 user nova-compute[70645]: INFO nova.compute.claims [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Claim successful on node user
Jul 24 15:15:58 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:15:58 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:15:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG nova.policy [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07525ed635a7407495f38c9556e7ce59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7f4608ea8242fcbacfba6754da3628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:15:58 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Creating image(s)
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "/opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "/opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "/opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.167s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk 1073741824" returned: 0 in 0.061s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:15:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Cannot resize image /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG nova.objects.instance [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'migration_context' on Instance uuid 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Ensure instance console log exists: /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-46961098-280b-4f6d-a324-b08d556d1c56 req-7fc0942d-d8bd-4f72-a5cf-9e80ff6b0974 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-46961098-280b-4f6d-a324-b08d556d1c56 req-7fc0942d-d8bd-4f72-a5cf-9e80ff6b0974 service nova] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-46961098-280b-4f6d-a324-b08d556d1c56 req-7fc0942d-d8bd-4f72-a5cf-9e80ff6b0974 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-46961098-280b-4f6d-a324-b08d556d1c56 req-7fc0942d-d8bd-4f72-a5cf-9e80ff6b0974 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-46961098-280b-4f6d-a324-b08d556d1c56 req-7fc0942d-d8bd-4f72-a5cf-9e80ff6b0974 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] No waiting events found dispatching network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:15:59 user nova-compute[70645]: WARNING nova.compute.manager [req-46961098-280b-4f6d-a324-b08d556d1c56 req-7fc0942d-d8bd-4f72-a5cf-9e80ff6b0974 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received unexpected event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 15:15:59 user nova-compute[70645]: DEBUG nova.network.neutron [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Successfully created port: b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:15:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Successfully updated port: b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "refresh_cache-138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquired lock "refresh_cache-138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Updating instance_info_cache with network_info: [{"id": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "address": "fa:16:3e:0a:3f:2d", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93985ac-f6", "ovs_interfaceid": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Releasing lock "refresh_cache-138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.compute.manager [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Instance network_info: |[{"id": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "address": "fa:16:3e:0a:3f:2d", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93985ac-f6", "ovs_interfaceid": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Start _get_guest_xml network_info=[{"id": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "address": "fa:16:3e:0a:3f:2d", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93985ac-f6", "ovs_interfaceid": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:16:00 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:16:00 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1878567581',display_name='tempest-AttachVolumeNegativeTest-server-1878567581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1878567581',id=40,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZlADAm9RRpCBh0YsWnEh6EeOUQeQBB4MrxSIeBSl0aH3I/qPHLH8dkpduaeVamak4JDzNgwjgtArfeYzziZFe3Z65PxFAzch9xpieZ4QH54x8RELivDz4pFZdoJgtDmg==',key_name='tempest-keypair-1132979618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-45e8301c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "address": "fa:16:3e:0a:3f:2d", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93985ac-f6", "ovs_interfaceid": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "address": "fa:16:3e:0a:3f:2d", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93985ac-f6", "ovs_interfaceid": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=b93985ac-f66e-44ab-8c2a-7c6f266f5c4b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93985ac-f6') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.objects.instance [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'pci_devices' on Instance uuid 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:16:00 user nova-compute[70645]:   <uuid>138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b</uuid>
Jul 24 15:16:00 user nova-compute[70645]:   <name>instance-00000028</name>
Jul 24 15:16:00 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:16:00 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:16:00 user nova-compute[70645]:   <metadata>
Jul 24 15:16:00 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:16:00 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:16:00 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1878567581</nova:name>
Jul 24 15:16:00 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:16:00</nova:creationTime>
Jul 24 15:16:00 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:16:00 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:16:00 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:16:00 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:16:00 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:16:00 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:16:00 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:16:00 user nova-compute[70645]:       <nova:owner>
Jul 24 15:16:00 user nova-compute[70645]:         <nova:user uuid="07525ed635a7407495f38c9556e7ce59">tempest-AttachVolumeNegativeTest-508353659-project-member</nova:user>
Jul 24 15:16:00 user nova-compute[70645]:         <nova:project uuid="de7f4608ea8242fcbacfba6754da3628">tempest-AttachVolumeNegativeTest-508353659</nova:project>
Jul 24 15:16:00 user nova-compute[70645]:       </nova:owner>
Jul 24 15:16:00 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:16:00 user nova-compute[70645]:       <nova:ports>
Jul 24 15:16:00 user nova-compute[70645]:         <nova:port uuid="b93985ac-f66e-44ab-8c2a-7c6f266f5c4b">
Jul 24 15:16:00 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 15:16:00 user nova-compute[70645]:         </nova:port>
Jul 24 15:16:00 user nova-compute[70645]:       </nova:ports>
Jul 24 15:16:00 user nova-compute[70645]:     </nova:instance>
Jul 24 15:16:00 user nova-compute[70645]:   </metadata>
Jul 24 15:16:00 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:16:00 user nova-compute[70645]:     <system>
Jul 24 15:16:00 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:16:00 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:16:00 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:16:00 user nova-compute[70645]:       <entry name="serial">138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b</entry>
Jul 24 15:16:00 user nova-compute[70645]:       <entry name="uuid">138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b</entry>
Jul 24 15:16:00 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:16:00 user nova-compute[70645]:     </system>
Jul 24 15:16:00 user nova-compute[70645]:   </sysinfo>
Jul 24 15:16:00 user nova-compute[70645]:   <os>
Jul 24 15:16:00 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:16:00 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:16:00 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:16:00 user nova-compute[70645]:   </os>
Jul 24 15:16:00 user nova-compute[70645]:   <features>
Jul 24 15:16:00 user nova-compute[70645]:     <acpi/>
Jul 24 15:16:00 user nova-compute[70645]:     <apic/>
Jul 24 15:16:00 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:16:00 user nova-compute[70645]:   </features>
Jul 24 15:16:00 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:16:00 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:16:00 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:16:00 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:16:00 user nova-compute[70645]:   </clock>
Jul 24 15:16:00 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:16:00 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:16:00 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:16:00 user nova-compute[70645]:   </cpu>
Jul 24 15:16:00 user nova-compute[70645]:   <devices>
Jul 24 15:16:00 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:16:00 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:16:00 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk"/>
Jul 24 15:16:00 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:16:00 user nova-compute[70645]:     </disk>
Jul 24 15:16:00 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:16:00 user nova-compute[70645]:       <mac address="fa:16:3e:0a:3f:2d"/>
Jul 24 15:16:00 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:16:00 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:16:00 user nova-compute[70645]:       <target dev="tapb93985ac-f6"/>
Jul 24 15:16:00 user nova-compute[70645]:     </interface>
Jul 24 15:16:00 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:16:00 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/console.log" append="off"/>
Jul 24 15:16:00 user nova-compute[70645]:     </serial>
Jul 24 15:16:00 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:16:00 user nova-compute[70645]:     <video>
Jul 24 15:16:00 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:16:00 user nova-compute[70645]:     </video>
Jul 24 15:16:00 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:16:00 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:16:00 user nova-compute[70645]:     </rng>
Jul 24 15:16:00 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:16:00 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:16:00 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:16:00 user nova-compute[70645]:     </memballoon>
Jul 24 15:16:00 user nova-compute[70645]:   </devices>
Jul 24 15:16:00 user nova-compute[70645]: </domain>
Jul 24 15:16:00 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1878567581',display_name='tempest-AttachVolumeNegativeTest-server-1878567581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1878567581',id=40,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZlADAm9RRpCBh0YsWnEh6EeOUQeQBB4MrxSIeBSl0aH3I/qPHLH8dkpduaeVamak4JDzNgwjgtArfeYzziZFe3Z65PxFAzch9xpieZ4QH54x8RELivDz4pFZdoJgtDmg==',key_name='tempest-keypair-1132979618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-45e8301c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "address": "fa:16:3e:0a:3f:2d", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93985ac-f6", "ovs_interfaceid": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "address": "fa:16:3e:0a:3f:2d", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93985ac-f6", "ovs_interfaceid": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=b93985ac-f66e-44ab-8c2a-7c6f266f5c4b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93985ac-f6') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG os_vif [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=b93985ac-f66e-44ab-8c2a-7c6f266f5c4b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93985ac-f6') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb93985ac-f6, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb93985ac-f6, col_values=(('external_ids', {'iface-id': 'b93985ac-f66e-44ab-8c2a-7c6f266f5c4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:3f:2d', 'vm-uuid': '138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:00 user nova-compute[70645]: INFO os_vif [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=b93985ac-f66e-44ab-8c2a-7c6f266f5c4b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93985ac-f6')
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:16:00 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No VIF found with MAC fa:16:3e:0a:3f:2d, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for 1372f999-32a0-4079-ab57-597093017d8b due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211761.0427496, 1372f999-32a0-4079-ab57-597093017d8b => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:16:01 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] VM Resumed (Lifecycle Event)
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:16:01 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Instance rebooted successfully.
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:16:01 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211761.043012, 1372f999-32a0-4079-ab57-597093017d8b => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:16:01 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] VM Started (Lifecycle Event)
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-d4411986-8c80-4b19-84a5-2b5addc9622d tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.734s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] No waiting events found dispatching network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:16:01 user nova-compute[70645]: WARNING nova.compute.manager [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received unexpected event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 for instance with vm_state active and task_state None.
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Received event network-changed-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.compute.manager [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Refreshing instance network info cache due to event network-changed-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] Acquiring lock "refresh_cache-138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] Acquired lock "refresh_cache-138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.network.neutron [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Refreshing network info cache for port b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.network.neutron [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Updated VIF entry in instance network info cache for port b93985ac-f66e-44ab-8c2a-7c6f266f5c4b. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG nova.network.neutron [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Updating instance_info_cache with network_info: [{"id": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "address": "fa:16:3e:0a:3f:2d", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93985ac-f6", "ovs_interfaceid": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:16:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e30dc9fe-8c3f-41df-a450-a6faa53ca61c req-bbc93c2d-2a5a-48c6-b366-ffcef19c83da service nova] Releasing lock "refresh_cache-138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:16:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-ffb330af-a672-427a-a3d7-7072bdd489d1 req-b8b1a43c-9977-4f1a-963e-58b41bd42656 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Received event network-vif-plugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:16:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ffb330af-a672-427a-a3d7-7072bdd489d1 req-b8b1a43c-9977-4f1a-963e-58b41bd42656 service nova] Acquiring lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:16:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ffb330af-a672-427a-a3d7-7072bdd489d1 req-b8b1a43c-9977-4f1a-963e-58b41bd42656 service nova] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:16:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ffb330af-a672-427a-a3d7-7072bdd489d1 req-b8b1a43c-9977-4f1a-963e-58b41bd42656 service nova] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-ffb330af-a672-427a-a3d7-7072bdd489d1 req-b8b1a43c-9977-4f1a-963e-58b41bd42656 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] No waiting events found dispatching network-vif-plugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:16:02 user nova-compute[70645]: WARNING nova.compute.manager [req-ffb330af-a672-427a-a3d7-7072bdd489d1 req-b8b1a43c-9977-4f1a-963e-58b41bd42656 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Received unexpected event network-vif-plugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b for instance with vm_state building and task_state spawning.
Jul 24 15:16:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211764.7418437, 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:16:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] VM Resumed (Lifecycle Event)
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:16:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Instance spawned successfully.
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:16:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211764.7449126, 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:16:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] VM Started (Lifecycle Event)
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:16:04 user nova-compute[70645]: INFO nova.compute.manager [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Took 6.53 seconds to spawn the instance on the hypervisor.
Jul 24 15:16:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:16:04 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:16:05 user nova-compute[70645]: INFO nova.compute.manager [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Took 7.27 seconds to build instance.
Jul 24 15:16:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-bece7800-eda0-4c36-a5a2-52df59d5f9c6 req-214ff743-7e65-438a-b293-c1b09295899d service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Received event network-vif-plugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:16:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bece7800-eda0-4c36-a5a2-52df59d5f9c6 req-214ff743-7e65-438a-b293-c1b09295899d service nova] Acquiring lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:16:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bece7800-eda0-4c36-a5a2-52df59d5f9c6 req-214ff743-7e65-438a-b293-c1b09295899d service nova] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:16:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bece7800-eda0-4c36-a5a2-52df59d5f9c6 req-214ff743-7e65-438a-b293-c1b09295899d service nova] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-bece7800-eda0-4c36-a5a2-52df59d5f9c6 req-214ff743-7e65-438a-b293-c1b09295899d service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] No waiting events found dispatching network-vif-plugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:16:05 user nova-compute[70645]: WARNING nova.compute.manager [req-bece7800-eda0-4c36-a5a2-52df59d5f9c6 req-214ff743-7e65-438a-b293-c1b09295899d service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Received unexpected event network-vif-plugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b for instance with vm_state active and task_state None.
Jul 24 15:16:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-120072fd-91c6-4135-8a45-bf0f3a5dac38 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.386s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:06 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211751.4076874, c71a9a04-efaf-4cdf-b494-d84412030cbf => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:16:06 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] VM Stopped (Lifecycle Event)
Jul 24 15:16:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0666c3ae-d8f6-4933-930a-6f90bae8d65f None None] [instance: c71a9a04-efaf-4cdf-b494-d84412030cbf] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:16:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:31 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:16:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:16:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:33 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:16:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:16:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:16:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:33 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:34 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:35 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:16:35 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:16:35 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8167MB free_disk=25.343517303466797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 1372f999-32a0-4079-ab57-597093017d8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 47016839-ba35-418a-af61-d2b9ed1ffccc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 936cb284-e0df-4640-ad6a-9719d334a26c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:16:35 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:16:36 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:16:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updating instance_info_cache with network_info: [{"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:16:37 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:16:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:41 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:16:41 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:16:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:16:43 user nova-compute[70645]: INFO nova.compute.manager [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] instance snapshotting
Jul 24 15:16:43 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Beginning live snapshot process
Jul 24 15:16:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json -f qcow2 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json -f qcow2 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.152s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpikfqvor_/c84ecb81f3ac43ea87aa70a54f160677.delta 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpikfqvor_/c84ecb81f3ac43ea87aa70a54f160677.delta 1073741824" returned: 0 in 0.059s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:44 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 15:16:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 15:16:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] COPY block job progress, current cursor: 23658496 final cursor: 75563008 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 15:16:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:16:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:16:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:16:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:16:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70645) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 15:16:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 15:16:46 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 15:16:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpikfqvor_/c84ecb81f3ac43ea87aa70a54f160677.delta /opt/stack/data/nova/instances/snapshots/tmpikfqvor_/c84ecb81f3ac43ea87aa70a54f160677 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpikfqvor_/c84ecb81f3ac43ea87aa70a54f160677.delta /opt/stack/data/nova/instances/snapshots/tmpikfqvor_/c84ecb81f3ac43ea87aa70a54f160677" returned: 0 in 0.601s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Snapshot extracted, beginning image upload
Jul 24 15:16:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Snapshot image upload complete
Jul 24 15:16:49 user nova-compute[70645]: INFO nova.compute.manager [None req-bf55ccf8-a96a-4784-a031-ecdf19fe06ff tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Took 6.29 seconds to snapshot the instance on the hypervisor.
Jul 24 15:16:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:16:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:16:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:16:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:16:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:16:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:16:54 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:16:54 user nova-compute[70645]: INFO nova.compute.claims [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Claim successful on node user
Jul 24 15:16:55 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG nova.network.neutron [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:16:55 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:16:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG nova.policy [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00e9c5d73ac941ed8b67471058c3db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d61e837ad1e437fb8b9ebee58a2e228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:16:55 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Creating image(s)
Jul 24 15:16:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "/opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "/opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "/opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "9aee09626ab4f746e99b334cba913a3a2df66cf7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:16:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "9aee09626ab4f746e99b334cba913a3a2df66cf7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:16:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7.part --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:56 user nova-compute[70645]: DEBUG nova.network.neutron [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Successfully created port: 9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:16:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7.part --force-share --output=json" returned: 0 in 0.161s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:56 user nova-compute[70645]: DEBUG nova.virt.images [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] c3a6482c-db54-432d-9999-ec58f1ec3d38 was qcow2, converting to raw {{(pid=70645) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 15:16:56 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 15:16:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7.part /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7.converted {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7.part /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7.converted" returned: 0 in 0.367s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7.converted --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "9aee09626ab4f746e99b334cba913a3a2df66cf7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.762s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7 --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7 --force-share --output=json" returned: 0 in 0.155s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "9aee09626ab4f746e99b334cba913a3a2df66cf7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "9aee09626ab4f746e99b334cba913a3a2df66cf7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7 --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7 --force-share --output=json" returned: 0 in 0.156s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7,backing_fmt=raw /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7,backing_fmt=raw /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk 1073741824" returned: 0 in 0.051s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "9aee09626ab4f746e99b334cba913a3a2df66cf7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7 --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Successfully updated port: 9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquired lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7 --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG nova.objects.instance [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'migration_context' on Instance uuid 299bd8c5-7663-46b5-a37e-ff2716ceec83 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-11bc16d7-0c92-40a2-8803-65b078cf9607 req-12f2f892-878f-4c50-93d3-b543ceeb904e service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received event network-changed-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-11bc16d7-0c92-40a2-8803-65b078cf9607 req-12f2f892-878f-4c50-93d3-b543ceeb904e service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Refreshing instance network info cache due to event network-changed-9289b0af-721b-4957-b8be-ccd34c289acf. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-11bc16d7-0c92-40a2-8803-65b078cf9607 req-12f2f892-878f-4c50-93d3-b543ceeb904e service nova] Acquiring lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Ensure instance console log exists: /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:16:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Updating instance_info_cache with network_info: [{"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Releasing lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Instance network_info: |[{"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-11bc16d7-0c92-40a2-8803-65b078cf9607 req-12f2f892-878f-4c50-93d3-b543ceeb904e service nova] Acquired lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.network.neutron [req-11bc16d7-0c92-40a2-8803-65b078cf9607 req-12f2f892-878f-4c50-93d3-b543ceeb904e service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Refreshing network info cache for port 9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Start _get_guest_xml network_info=[{"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7474bbc9733a7fec442f6bb226c7569a',container_format='bare',created_at=2023-07-24T15:16:43Z,direct_url=<?>,disk_format='qcow2',id=c3a6482c-db54-432d-9999-ec58f1ec3d38,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-493863151',owner='2d61e837ad1e437fb8b9ebee58a2e228',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-24T15:16:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'c3a6482c-db54-432d-9999-ec58f1ec3d38'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:16:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:16:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7474bbc9733a7fec442f6bb226c7569a',container_format='bare',created_at=2023-07-24T15:16:43Z,direct_url=<?>,disk_format='qcow2',id=c3a6482c-db54-432d-9999-ec58f1ec3d38,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-493863151',owner='2d61e837ad1e437fb8b9ebee58a2e228',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-24T15:16:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-730711147',display_name='tempest-TestStampPattern-server-730711147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-730711147',id=41,image_ref='c3a6482c-db54-432d-9999-ec58f1ec3d38',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpaiR09gawF0BiABPWc5BhN+ZqJhKaACzOhcrf2boJj0UiD0Yx//+fQ+eBUaDKWD1VfnztdaIfJWCRQbiO7xZZ9eT9akk4tzJdcm5XEY3bK9HSekgcRSxxbsyrKUsbDHw==',key_name='tempest-TestStampPattern-922639899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d61e837ad1e437fb8b9ebee58a2e228',ramdisk_id='',reservation_id='r-txfntuxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='47016839-ba35-418a-af61-d2b9ed1ffccc',image_min_disk='1',image_min_ram='0',image_owner_id='2d61e837ad1e437fb8b9ebee58a2e228',image_owner_project_name='tempest-TestStampPattern-63827052',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-63827052-project-member',image_user_id='00e9c5d73ac941ed8b67471058c3db0a',network_allocated='True',owner_project_name='tempest-TestStampPattern-63827052',owner_user_name='tempest-TestStampPattern-63827052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:16:55Z,user_data=None,user_id='00e9c5d73ac941ed8b67471058c3db0a',uuid=299bd8c5-7663-46b5-a37e-ff2716ceec83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converting VIF {"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=9289b0af-721b-4957-b8be-ccd34c289acf,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9289b0af-72') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.objects.instance [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'pci_devices' on Instance uuid 299bd8c5-7663-46b5-a37e-ff2716ceec83 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:16:58 user nova-compute[70645]:   <uuid>299bd8c5-7663-46b5-a37e-ff2716ceec83</uuid>
Jul 24 15:16:58 user nova-compute[70645]:   <name>instance-00000029</name>
Jul 24 15:16:58 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:16:58 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:16:58 user nova-compute[70645]:   <metadata>
Jul 24 15:16:58 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:16:58 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:16:58 user nova-compute[70645]:       <nova:name>tempest-TestStampPattern-server-730711147</nova:name>
Jul 24 15:16:58 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:16:58</nova:creationTime>
Jul 24 15:16:58 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:16:58 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:16:58 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:16:58 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:16:58 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:16:58 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:16:58 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:16:58 user nova-compute[70645]:       <nova:owner>
Jul 24 15:16:58 user nova-compute[70645]:         <nova:user uuid="00e9c5d73ac941ed8b67471058c3db0a">tempest-TestStampPattern-63827052-project-member</nova:user>
Jul 24 15:16:58 user nova-compute[70645]:         <nova:project uuid="2d61e837ad1e437fb8b9ebee58a2e228">tempest-TestStampPattern-63827052</nova:project>
Jul 24 15:16:58 user nova-compute[70645]:       </nova:owner>
Jul 24 15:16:58 user nova-compute[70645]:       <nova:root type="image" uuid="c3a6482c-db54-432d-9999-ec58f1ec3d38"/>
Jul 24 15:16:58 user nova-compute[70645]:       <nova:ports>
Jul 24 15:16:58 user nova-compute[70645]:         <nova:port uuid="9289b0af-721b-4957-b8be-ccd34c289acf">
Jul 24 15:16:58 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 15:16:58 user nova-compute[70645]:         </nova:port>
Jul 24 15:16:58 user nova-compute[70645]:       </nova:ports>
Jul 24 15:16:58 user nova-compute[70645]:     </nova:instance>
Jul 24 15:16:58 user nova-compute[70645]:   </metadata>
Jul 24 15:16:58 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:16:58 user nova-compute[70645]:     <system>
Jul 24 15:16:58 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:16:58 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:16:58 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:16:58 user nova-compute[70645]:       <entry name="serial">299bd8c5-7663-46b5-a37e-ff2716ceec83</entry>
Jul 24 15:16:58 user nova-compute[70645]:       <entry name="uuid">299bd8c5-7663-46b5-a37e-ff2716ceec83</entry>
Jul 24 15:16:58 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:16:58 user nova-compute[70645]:     </system>
Jul 24 15:16:58 user nova-compute[70645]:   </sysinfo>
Jul 24 15:16:58 user nova-compute[70645]:   <os>
Jul 24 15:16:58 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:16:58 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:16:58 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:16:58 user nova-compute[70645]:   </os>
Jul 24 15:16:58 user nova-compute[70645]:   <features>
Jul 24 15:16:58 user nova-compute[70645]:     <acpi/>
Jul 24 15:16:58 user nova-compute[70645]:     <apic/>
Jul 24 15:16:58 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:16:58 user nova-compute[70645]:   </features>
Jul 24 15:16:58 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:16:58 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:16:58 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:16:58 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:16:58 user nova-compute[70645]:   </clock>
Jul 24 15:16:58 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:16:58 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:16:58 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:16:58 user nova-compute[70645]:   </cpu>
Jul 24 15:16:58 user nova-compute[70645]:   <devices>
Jul 24 15:16:58 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:16:58 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:16:58 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk"/>
Jul 24 15:16:58 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:16:58 user nova-compute[70645]:     </disk>
Jul 24 15:16:58 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:16:58 user nova-compute[70645]:       <mac address="fa:16:3e:5b:1b:52"/>
Jul 24 15:16:58 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:16:58 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:16:58 user nova-compute[70645]:       <target dev="tap9289b0af-72"/>
Jul 24 15:16:58 user nova-compute[70645]:     </interface>
Jul 24 15:16:58 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:16:58 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/console.log" append="off"/>
Jul 24 15:16:58 user nova-compute[70645]:     </serial>
Jul 24 15:16:58 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:16:58 user nova-compute[70645]:     <video>
Jul 24 15:16:58 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:16:58 user nova-compute[70645]:     </video>
Jul 24 15:16:58 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:16:58 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:16:58 user nova-compute[70645]:     </rng>
Jul 24 15:16:58 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:16:58 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:16:58 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:16:58 user nova-compute[70645]:     </memballoon>
Jul 24 15:16:58 user nova-compute[70645]:   </devices>
Jul 24 15:16:58 user nova-compute[70645]: </domain>
Jul 24 15:16:58 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-730711147',display_name='tempest-TestStampPattern-server-730711147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-730711147',id=41,image_ref='c3a6482c-db54-432d-9999-ec58f1ec3d38',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpaiR09gawF0BiABPWc5BhN+ZqJhKaACzOhcrf2boJj0UiD0Yx//+fQ+eBUaDKWD1VfnztdaIfJWCRQbiO7xZZ9eT9akk4tzJdcm5XEY3bK9HSekgcRSxxbsyrKUsbDHw==',key_name='tempest-TestStampPattern-922639899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d61e837ad1e437fb8b9ebee58a2e228',ramdisk_id='',reservation_id='r-txfntuxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='47016839-ba35-418a-af61-d2b9ed1ffccc',image_min_disk='1',image_min_ram='0',image_owner_id='2d61e837ad1e437fb8b9ebee58a2e228',image_owner_project_name='tempest-TestStampPattern-63827052',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-63827052-project-member',image_user_id='00e9c5d73ac941ed8b67471058c3db0a',network_allocated='True',owner_project_name='tempest-TestStampPattern-63827052',owner_user_name='tempest-TestStampPattern-63827052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:16:55Z,user_data=None,user_id='00e9c5d73ac941ed8b67471058c3db0a',uuid=299bd8c5-7663-46b5-a37e-ff2716ceec83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converting VIF {"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=9289b0af-721b-4957-b8be-ccd34c289acf,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9289b0af-72') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG os_vif [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=9289b0af-721b-4957-b8be-ccd34c289acf,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9289b0af-72') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9289b0af-72, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9289b0af-72, col_values=(('external_ids', {'iface-id': '9289b0af-721b-4957-b8be-ccd34c289acf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:1b:52', 'vm-uuid': '299bd8c5-7663-46b5-a37e-ff2716ceec83'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:16:58 user nova-compute[70645]: INFO os_vif [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=9289b0af-721b-4957-b8be-ccd34c289acf,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9289b0af-72')
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:16:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] No VIF found with MAC fa:16:3e:5b:1b:52, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:16:59 user nova-compute[70645]: DEBUG nova.network.neutron [req-11bc16d7-0c92-40a2-8803-65b078cf9607 req-12f2f892-878f-4c50-93d3-b543ceeb904e service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Updated VIF entry in instance network info cache for port 9289b0af-721b-4957-b8be-ccd34c289acf. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:16:59 user nova-compute[70645]: DEBUG nova.network.neutron [req-11bc16d7-0c92-40a2-8803-65b078cf9607 req-12f2f892-878f-4c50-93d3-b543ceeb904e service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Updating instance_info_cache with network_info: [{"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:16:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-11bc16d7-0c92-40a2-8803-65b078cf9607 req-12f2f892-878f-4c50-93d3-b543ceeb904e service nova] Releasing lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:16:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-bef85a38-33fc-4aa8-a69f-bff98b17b7eb req-185a6cf8-df5e-4293-b486-2d272d3de977 service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received event network-vif-plugged-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:17:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bef85a38-33fc-4aa8-a69f-bff98b17b7eb req-185a6cf8-df5e-4293-b486-2d272d3de977 service nova] Acquiring lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bef85a38-33fc-4aa8-a69f-bff98b17b7eb req-185a6cf8-df5e-4293-b486-2d272d3de977 service nova] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bef85a38-33fc-4aa8-a69f-bff98b17b7eb req-185a6cf8-df5e-4293-b486-2d272d3de977 service nova] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-bef85a38-33fc-4aa8-a69f-bff98b17b7eb req-185a6cf8-df5e-4293-b486-2d272d3de977 service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] No waiting events found dispatching network-vif-plugged-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:17:00 user nova-compute[70645]: WARNING nova.compute.manager [req-bef85a38-33fc-4aa8-a69f-bff98b17b7eb req-185a6cf8-df5e-4293-b486-2d272d3de977 service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received unexpected event network-vif-plugged-9289b0af-721b-4957-b8be-ccd34c289acf for instance with vm_state building and task_state spawning.
Jul 24 15:17:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211822.3817081, 299bd8c5-7663-46b5-a37e-ff2716ceec83 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:17:02 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] VM Resumed (Lifecycle Event)
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.compute.manager [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:17:02 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Instance spawned successfully.
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-0e66249e-85ae-4cb4-be82-8972bf1f5943 req-86e61940-b13b-4fe7-986b-20a9ea2dafea service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received event network-vif-plugged-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:17:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0e66249e-85ae-4cb4-be82-8972bf1f5943 req-86e61940-b13b-4fe7-986b-20a9ea2dafea service nova] Acquiring lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0e66249e-85ae-4cb4-be82-8972bf1f5943 req-86e61940-b13b-4fe7-986b-20a9ea2dafea service nova] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0e66249e-85ae-4cb4-be82-8972bf1f5943 req-86e61940-b13b-4fe7-986b-20a9ea2dafea service nova] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.compute.manager [req-0e66249e-85ae-4cb4-be82-8972bf1f5943 req-86e61940-b13b-4fe7-986b-20a9ea2dafea service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] No waiting events found dispatching network-vif-plugged-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:17:02 user nova-compute[70645]: WARNING nova.compute.manager [req-0e66249e-85ae-4cb4-be82-8972bf1f5943 req-86e61940-b13b-4fe7-986b-20a9ea2dafea service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received unexpected event network-vif-plugged-9289b0af-721b-4957-b8be-ccd34c289acf for instance with vm_state building and task_state spawning.
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:17:02 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211822.3851838, 299bd8c5-7663-46b5-a37e-ff2716ceec83 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:17:02 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] VM Started (Lifecycle Event)
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:17:02 user nova-compute[70645]: INFO nova.compute.manager [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Took 7.06 seconds to spawn the instance on the hypervisor.
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.compute.manager [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:17:02 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:17:02 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:17:02 user nova-compute[70645]: INFO nova.compute.manager [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Took 7.77 seconds to build instance.
Jul 24 15:17:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-294aa972-2d1c-4aec-a5d6-938497fd6791 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.883s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "382ff84d-d789-42fc-8b21-d848b9978da5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "382ff84d-d789-42fc-8b21-d848b9978da5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:17:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:20 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:17:20 user nova-compute[70645]: INFO nova.compute.claims [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Claim successful on node user
Jul 24 15:17:20 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:17:20 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:17:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:17:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:17:20 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:17:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:17:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:17:20 user nova-compute[70645]: DEBUG nova.policy [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a83e71e487ca401eb10e1d41d77b86fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92f320224c4b1e98b371f510a5e198', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:17:20 user nova-compute[70645]: INFO nova.virt.block_device [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Booting with volume snapshot 6351c036-a1d4-4e89-abc3-f619a33d0544 at /dev/vda
Jul 24 15:17:21 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Successfully created port: 7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Successfully updated port: 7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "refresh_cache-382ff84d-d789-42fc-8b21-d848b9978da5" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquired lock "refresh_cache-382ff84d-d789-42fc-8b21-d848b9978da5" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-024633f3-a174-49ba-852f-a14fb2b1ec55 req-bb7700a7-df06-4e75-993a-e6f4d2bb1f17 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Received event network-changed-7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-024633f3-a174-49ba-852f-a14fb2b1ec55 req-bb7700a7-df06-4e75-993a-e6f4d2bb1f17 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Refreshing instance network info cache due to event network-changed-7a28b840-b759-42dc-ad11-a3214ebf9bb9. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-024633f3-a174-49ba-852f-a14fb2b1ec55 req-bb7700a7-df06-4e75-993a-e6f4d2bb1f17 service nova] Acquiring lock "refresh_cache-382ff84d-d789-42fc-8b21-d848b9978da5" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG nova.network.neutron [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Updating instance_info_cache with network_info: [{"id": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "address": "fa:16:3e:9b:4a:44", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a28b840-b7", "ovs_interfaceid": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Releasing lock "refresh_cache-382ff84d-d789-42fc-8b21-d848b9978da5" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Instance network_info: |[{"id": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "address": "fa:16:3e:9b:4a:44", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a28b840-b7", "ovs_interfaceid": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-024633f3-a174-49ba-852f-a14fb2b1ec55 req-bb7700a7-df06-4e75-993a-e6f4d2bb1f17 service nova] Acquired lock "refresh_cache-382ff84d-d789-42fc-8b21-d848b9978da5" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:17:22 user nova-compute[70645]: DEBUG nova.network.neutron [req-024633f3-a174-49ba-852f-a14fb2b1ec55 req-bb7700a7-df06-4e75-993a-e6f4d2bb1f17 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Refreshing network info cache for port 7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:17:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:23 user nova-compute[70645]: DEBUG nova.network.neutron [req-024633f3-a174-49ba-852f-a14fb2b1ec55 req-bb7700a7-df06-4e75-993a-e6f4d2bb1f17 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Updated VIF entry in instance network info cache for port 7a28b840-b759-42dc-ad11-a3214ebf9bb9. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:17:23 user nova-compute[70645]: DEBUG nova.network.neutron [req-024633f3-a174-49ba-852f-a14fb2b1ec55 req-bb7700a7-df06-4e75-993a-e6f4d2bb1f17 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Updating instance_info_cache with network_info: [{"id": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "address": "fa:16:3e:9b:4a:44", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a28b840-b7", "ovs_interfaceid": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:17:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-024633f3-a174-49ba-852f-a14fb2b1ec55 req-bb7700a7-df06-4e75-993a-e6f4d2bb1f17 service nova] Releasing lock "refresh_cache-382ff84d-d789-42fc-8b21-d848b9978da5" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG os_brick.utils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fefedf-9826-4976-a1df-f2c3155d4107]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33b0b81-e3fd-4a80-bd2b-a4954e28aa54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac819ff-202d-4dc2-8480-bbcdaff8aa52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25090d8-a505-44e3-bc44-06044e1bfb24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:17:26 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:17:26 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eb7fd0-17a3-4e00-b3f9-89d1c22d79be]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG os_brick.utils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:17:26 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Updating existing volume attachment record: cfd72247-ca16-4855-a444-800b661857dc {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:17:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:17:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Creating image(s)
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Ensure instance console log exists: /opt/stack/data/nova/instances/382ff84d-d789-42fc-8b21-d848b9978da5/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Start _get_guest_xml network_info=[{"id": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "address": "fa:16:3e:9b:4a:44", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a28b840-b7", "ovs_interfaceid": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cfd72247-ca16-4855-a444-800b661857dc', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuJARgVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '382ff84d-d789-42fc-8b21-d848b9978da5', 'attached_at': '', 'detached_at': '', 'volume_id': '0152744d-5061-4247-8e69-0c9b6277fe77', 'serial': '0152744d-5061-4247-8e69-0c9b6277fe77'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:17:32 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:17:32 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:17:32 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuJARgVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:17:33 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:17:33 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:17:33 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7366d5d0-a52f-44ac-9c50-b3f65ab258e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:17:33 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[091c042a-fada-4823-bd84-64faf49bb16e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77] added
Jul 24 15:17:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cba22c-e3ef-4e3d-84e7-f1e93ad01843]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2c020e-d8f8-4f9a-9d2b-838a43486cca]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuJARgVe {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuJARgVe" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf3c847-9695-4070-818a-c1653c44a7d4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LuJARgVe'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2f77ff-df46-4fce-a466-56fa17c7bb1b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44bdbcf-4791-47de-afab-152861b26740]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:17:33 user nova-compute[70645]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:17:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:17:33 user nova-compute[70645]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:17:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7375bbb0-71e7-4b31-bb0a-d4a538dfa344]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77, portal: 172.16.0.220,3260]
Jul 24 15:17:33 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77, portal: 172.16.0.220,3260] successful.
Jul 24 15:17:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa211cca-11fd-4133-aa06-fa776ae72369]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ee65e4-f9c6-43b5-9041-33dfb42fcb8a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:17:33 user nova-compute[70645]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:17:33 user nova-compute[70645]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:17:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:17:33 user nova-compute[70645]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:17:33 user nova-compute[70645]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:17:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc4280b-3cae-4143-8df0-8d7b9515605e]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:17:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuJARgVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23934303864633335', 'path': '/dev/sdd'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934303864633335', 'path': '/dev/sdd'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-762083338',display_name='tempest-TestVolumeBootPattern-server-762083338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-762083338',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-z0m6dqll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:17:20Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=382ff84d-d789-42fc-8b21-d848b9978da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "address": "fa:16:3e:9b:4a:44", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a28b840-b7", "ovs_interfaceid": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "address": "fa:16:3e:9b:4a:44", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a28b840-b7", "ovs_interfaceid": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4a:44,bridge_name='br-int',has_traffic_filtering=True,id=7a28b840-b759-42dc-ad11-a3214ebf9bb9,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a28b840-b7') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'pci_devices' on Instance uuid 382ff84d-d789-42fc-8b21-d848b9978da5 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:17:34 user nova-compute[70645]:   <uuid>382ff84d-d789-42fc-8b21-d848b9978da5</uuid>
Jul 24 15:17:34 user nova-compute[70645]:   <name>instance-0000002a</name>
Jul 24 15:17:34 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:17:34 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:17:34 user nova-compute[70645]:   <metadata>
Jul 24 15:17:34 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:17:34 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:17:34 user nova-compute[70645]:       <nova:name>tempest-TestVolumeBootPattern-server-762083338</nova:name>
Jul 24 15:17:34 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:17:32</nova:creationTime>
Jul 24 15:17:34 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:17:34 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:17:34 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:17:34 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:17:34 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:17:34 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:17:34 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:17:34 user nova-compute[70645]:       <nova:owner>
Jul 24 15:17:34 user nova-compute[70645]:         <nova:user uuid="a83e71e487ca401eb10e1d41d77b86fe">tempest-TestVolumeBootPattern-1424700934-project-member</nova:user>
Jul 24 15:17:34 user nova-compute[70645]:         <nova:project uuid="6f92f320224c4b1e98b371f510a5e198">tempest-TestVolumeBootPattern-1424700934</nova:project>
Jul 24 15:17:34 user nova-compute[70645]:       </nova:owner>
Jul 24 15:17:34 user nova-compute[70645]:       <nova:ports>
Jul 24 15:17:34 user nova-compute[70645]:         <nova:port uuid="7a28b840-b759-42dc-ad11-a3214ebf9bb9">
Jul 24 15:17:34 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 15:17:34 user nova-compute[70645]:         </nova:port>
Jul 24 15:17:34 user nova-compute[70645]:       </nova:ports>
Jul 24 15:17:34 user nova-compute[70645]:     </nova:instance>
Jul 24 15:17:34 user nova-compute[70645]:   </metadata>
Jul 24 15:17:34 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:17:34 user nova-compute[70645]:     <system>
Jul 24 15:17:34 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:17:34 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:17:34 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:17:34 user nova-compute[70645]:       <entry name="serial">382ff84d-d789-42fc-8b21-d848b9978da5</entry>
Jul 24 15:17:34 user nova-compute[70645]:       <entry name="uuid">382ff84d-d789-42fc-8b21-d848b9978da5</entry>
Jul 24 15:17:34 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:17:34 user nova-compute[70645]:     </system>
Jul 24 15:17:34 user nova-compute[70645]:   </sysinfo>
Jul 24 15:17:34 user nova-compute[70645]:   <os>
Jul 24 15:17:34 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:17:34 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:17:34 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:17:34 user nova-compute[70645]:   </os>
Jul 24 15:17:34 user nova-compute[70645]:   <features>
Jul 24 15:17:34 user nova-compute[70645]:     <acpi/>
Jul 24 15:17:34 user nova-compute[70645]:     <apic/>
Jul 24 15:17:34 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:17:34 user nova-compute[70645]:   </features>
Jul 24 15:17:34 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:17:34 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:17:34 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:17:34 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:17:34 user nova-compute[70645]:   </clock>
Jul 24 15:17:34 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:17:34 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:17:34 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:17:34 user nova-compute[70645]:   </cpu>
Jul 24 15:17:34 user nova-compute[70645]:   <devices>
Jul 24 15:17:34 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:17:34 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:17:34 user nova-compute[70645]:       <source dev="/dev/sdd"/>
Jul 24 15:17:34 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:17:34 user nova-compute[70645]:       <serial>0152744d-5061-4247-8e69-0c9b6277fe77</serial>
Jul 24 15:17:34 user nova-compute[70645]:     </disk>
Jul 24 15:17:34 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:17:34 user nova-compute[70645]:       <mac address="fa:16:3e:9b:4a:44"/>
Jul 24 15:17:34 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:17:34 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:17:34 user nova-compute[70645]:       <target dev="tap7a28b840-b7"/>
Jul 24 15:17:34 user nova-compute[70645]:     </interface>
Jul 24 15:17:34 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:17:34 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/382ff84d-d789-42fc-8b21-d848b9978da5/console.log" append="off"/>
Jul 24 15:17:34 user nova-compute[70645]:     </serial>
Jul 24 15:17:34 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:17:34 user nova-compute[70645]:     <video>
Jul 24 15:17:34 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:17:34 user nova-compute[70645]:     </video>
Jul 24 15:17:34 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:17:34 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:17:34 user nova-compute[70645]:     </rng>
Jul 24 15:17:34 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:17:34 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:17:34 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:17:34 user nova-compute[70645]:     </memballoon>
Jul 24 15:17:34 user nova-compute[70645]:   </devices>
Jul 24 15:17:34 user nova-compute[70645]: </domain>
Jul 24 15:17:34 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-762083338',display_name='tempest-TestVolumeBootPattern-server-762083338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-762083338',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-z0m6dqll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:17:20Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=382ff84d-d789-42fc-8b21-d848b9978da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "address": "fa:16:3e:9b:4a:44", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a28b840-b7", "ovs_interfaceid": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "address": "fa:16:3e:9b:4a:44", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a28b840-b7", "ovs_interfaceid": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4a:44,bridge_name='br-int',has_traffic_filtering=True,id=7a28b840-b759-42dc-ad11-a3214ebf9bb9,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a28b840-b7') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG os_vif [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4a:44,bridge_name='br-int',has_traffic_filtering=True,id=7a28b840-b759-42dc-ad11-a3214ebf9bb9,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a28b840-b7') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a28b840-b7, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a28b840-b7, col_values=(('external_ids', {'iface-id': '7a28b840-b759-42dc-ad11-a3214ebf9bb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:4a:44', 'vm-uuid': '382ff84d-d789-42fc-8b21-d848b9978da5'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:34 user nova-compute[70645]: INFO os_vif [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4a:44,bridge_name='br-int',has_traffic_filtering=True,id=7a28b840-b759-42dc-ad11-a3214ebf9bb9,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a28b840-b7')
Jul 24 15:17:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:17:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No VIF found with MAC fa:16:3e:9b:4a:44, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:17:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:17:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:17:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-1a2b3a7d-2cc3-4a96-a516-fe17fb22b259 req-b3ad9e5d-c5ff-4e8e-a79b-358906dfea76 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Received event network-vif-plugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:17:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1a2b3a7d-2cc3-4a96-a516-fe17fb22b259 req-b3ad9e5d-c5ff-4e8e-a79b-358906dfea76 service nova] Acquiring lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1a2b3a7d-2cc3-4a96-a516-fe17fb22b259 req-b3ad9e5d-c5ff-4e8e-a79b-358906dfea76 service nova] Lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1a2b3a7d-2cc3-4a96-a516-fe17fb22b259 req-b3ad9e5d-c5ff-4e8e-a79b-358906dfea76 service nova] Lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-1a2b3a7d-2cc3-4a96-a516-fe17fb22b259 req-b3ad9e5d-c5ff-4e8e-a79b-358906dfea76 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] No waiting events found dispatching network-vif-plugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:17:35 user nova-compute[70645]: WARNING nova.compute.manager [req-1a2b3a7d-2cc3-4a96-a516-fe17fb22b259 req-b3ad9e5d-c5ff-4e8e-a79b-358906dfea76 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Received unexpected event network-vif-plugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 for instance with vm_state building and task_state spawning.
Jul 24 15:17:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Updating instance_info_cache with network_info: [{"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-936cb284-e0df-4640-ad6a-9719d334a26c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:17:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211857.916116, 382ff84d-d789-42fc-8b21-d848b9978da5 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:17:37 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] VM Resumed (Lifecycle Event)
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:17:37 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Instance spawned successfully.
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:17:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:17:38 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:17:38 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211857.9169927, 382ff84d-d789-42fc-8b21-d848b9978da5 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:17:38 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] VM Started (Lifecycle Event)
Jul 24 15:17:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:38 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:17:38 user nova-compute[70645]: INFO nova.compute.manager [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Took 5.13 seconds to spawn the instance on the hypervisor.
Jul 24 15:17:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-1808de18-e7b9-4f5a-a394-84b82352fdad req-9dc8b7f5-1bc9-469d-a79a-f8c4fc9eb5d5 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Received event network-vif-plugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1808de18-e7b9-4f5a-a394-84b82352fdad req-9dc8b7f5-1bc9-469d-a79a-f8c4fc9eb5d5 service nova] Acquiring lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1808de18-e7b9-4f5a-a394-84b82352fdad req-9dc8b7f5-1bc9-469d-a79a-f8c4fc9eb5d5 service nova] Lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1808de18-e7b9-4f5a-a394-84b82352fdad req-9dc8b7f5-1bc9-469d-a79a-f8c4fc9eb5d5 service nova] Lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-1808de18-e7b9-4f5a-a394-84b82352fdad req-9dc8b7f5-1bc9-469d-a79a-f8c4fc9eb5d5 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] No waiting events found dispatching network-vif-plugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:17:38 user nova-compute[70645]: WARNING nova.compute.manager [req-1808de18-e7b9-4f5a-a394-84b82352fdad req-9dc8b7f5-1bc9-469d-a79a-f8c4fc9eb5d5 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Received unexpected event network-vif-plugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 for instance with vm_state building and task_state spawning.
Jul 24 15:17:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:38 user nova-compute[70645]: INFO nova.compute.manager [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Took 18.29 seconds to build instance.
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7184f1ee-15f8-4e60-a7d3-a4187d979c3d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "382ff84d-d789-42fc-8b21-d848b9978da5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.386s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:38 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:17:38 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:17:38 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8207MB free_disk=25.168445587158203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 1372f999-32a0-4079-ab57-597093017d8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 47016839-ba35-418a-af61-d2b9ed1ffccc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 936cb284-e0df-4640-ad6a-9719d334a26c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 299bd8c5-7663-46b5-a37e-ff2716ceec83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 382ff84d-d789-42fc-8b21-d848b9978da5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:17:39 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:17:40 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:17:42 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:17:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-377a7334-1058-4d88-b0e1-1e2bb709d31f req-2197cb6f-98f7-4d39-95cc-7fba7bba08d9 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-changed-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:17:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-377a7334-1058-4d88-b0e1-1e2bb709d31f req-2197cb6f-98f7-4d39-95cc-7fba7bba08d9 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Refreshing instance network info cache due to event network-changed-4dee8450-99dd-4a74-b710-6760a5a94e79. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:17:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-377a7334-1058-4d88-b0e1-1e2bb709d31f req-2197cb6f-98f7-4d39-95cc-7fba7bba08d9 service nova] Acquiring lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:17:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-377a7334-1058-4d88-b0e1-1e2bb709d31f req-2197cb6f-98f7-4d39-95cc-7fba7bba08d9 service nova] Acquired lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:17:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-377a7334-1058-4d88-b0e1-1e2bb709d31f req-2197cb6f-98f7-4d39-95cc-7fba7bba08d9 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Refreshing network info cache for port 4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:17:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-377a7334-1058-4d88-b0e1-1e2bb709d31f req-2197cb6f-98f7-4d39-95cc-7fba7bba08d9 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updated VIF entry in instance network info cache for port 4dee8450-99dd-4a74-b710-6760a5a94e79. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:17:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-377a7334-1058-4d88-b0e1-1e2bb709d31f req-2197cb6f-98f7-4d39-95cc-7fba7bba08d9 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updating instance_info_cache with network_info: [{"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-377a7334-1058-4d88-b0e1-1e2bb709d31f req-2197cb6f-98f7-4d39-95cc-7fba7bba08d9 service nova] Releasing lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG nova.compute.manager [req-b50b54b8-36eb-4039-9770-acd39d5f7db2 req-6622ea7c-80dd-4c9a-8315-9d4b29273939 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-changed-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG nova.compute.manager [req-b50b54b8-36eb-4039-9770-acd39d5f7db2 req-6622ea7c-80dd-4c9a-8315-9d4b29273939 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Refreshing instance network info cache due to event network-changed-4dee8450-99dd-4a74-b710-6760a5a94e79. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b50b54b8-36eb-4039-9770-acd39d5f7db2 req-6622ea7c-80dd-4c9a-8315-9d4b29273939 service nova] Acquiring lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b50b54b8-36eb-4039-9770-acd39d5f7db2 req-6622ea7c-80dd-4c9a-8315-9d4b29273939 service nova] Acquired lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG nova.network.neutron [req-b50b54b8-36eb-4039-9770-acd39d5f7db2 req-6622ea7c-80dd-4c9a-8315-9d4b29273939 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Refreshing network info cache for port 4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:46 user nova-compute[70645]: INFO nova.compute.manager [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Detaching volume e27149c3-1502-46ae-bcdd-54061e931cff
Jul 24 15:17:46 user nova-compute[70645]: INFO nova.virt.block_device [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Attempting to driver detach volume e27149c3-1502-46ae-bcdd-54061e931cff from mountpoint /dev/vdb
Jul 24 15:17:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Attempting to detach device vdb from instance 1372f999-32a0-4079-ab57-597093017d8b from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:17:46 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:17:46 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:17:46 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:17:46 user nova-compute[70645]:   <serial>e27149c3-1502-46ae-bcdd-54061e931cff</serial>
Jul 24 15:17:46 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 15:17:46 user nova-compute[70645]: </disk>
Jul 24 15:17:46 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:17:46 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Successfully detached device vdb from instance 1372f999-32a0-4079-ab57-597093017d8b from the persistent domain config.
Jul 24 15:17:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1372f999-32a0-4079-ab57-597093017d8b from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:17:46 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:17:46 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:17:46 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:17:46 user nova-compute[70645]:   <serial>e27149c3-1502-46ae-bcdd-54061e931cff</serial>
Jul 24 15:17:46 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 15:17:46 user nova-compute[70645]: </disk>
Jul 24 15:17:46 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG nova.network.neutron [req-b50b54b8-36eb-4039-9770-acd39d5f7db2 req-6622ea7c-80dd-4c9a-8315-9d4b29273939 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updated VIF entry in instance network info cache for port 4dee8450-99dd-4a74-b710-6760a5a94e79. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG nova.network.neutron [req-b50b54b8-36eb-4039-9770-acd39d5f7db2 req-6622ea7c-80dd-4c9a-8315-9d4b29273939 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updating instance_info_cache with network_info: [{"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:17:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b50b54b8-36eb-4039-9770-acd39d5f7db2 req-6622ea7c-80dd-4c9a-8315-9d4b29273939 service nova] Releasing lock "refresh_cache-1372f999-32a0-4079-ab57-597093017d8b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211867.1153297, 1372f999-32a0-4079-ab57-597093017d8b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:17:47 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Successfully detached device vdb from instance 1372f999-32a0-4079-ab57-597093017d8b from the live domain config.
Jul 24 15:17:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpySzdJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:17:47 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4ce8fd-2b2d-45b8-a4b0-fba6777fdf61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf1bcc8-0eb8-4818-8b77-ee2ddde1cb15]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:17:47 user nova-compute[70645]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:17:47 user nova-compute[70645]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:17:47 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:17:47 user nova-compute[70645]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff (non-flash)
Jul 24 15:17:47 user nova-compute[70645]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:17:47 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba942b25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[77424fcc-b8ec-4381-ab3f-5bbb115aa664]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8ee1a1-9143-413b-8bcd-312fcf073c78]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30776c-9d79-463f-a7af-1d8a53c85f9c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e6c1a1-54c3-4cbf-9077-33d3ec8a9954]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d54a4ab-acbe-4257-b1a3-a9f0734f1f79]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[91435495-aefe-4233-b96d-f7f0ed33d3dd]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260]
Jul 24 15:17:47 user nova-compute[70645]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff, portal: 172.16.0.220,3260] successful.
Jul 24 15:17:47 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27149c3-1502-46ae-bcdd-54061e931cff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74fe47a-220c-484d-a006-9b210666153e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] <== disconnect_volume: return (320ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:17:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:17:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:48 user nova-compute[70645]: DEBUG nova.objects.instance [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'flavor' on Instance uuid 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:17:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-3b3e0f4c-f5ed-4676-9bbd-700ae0e8214e tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.753s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-4a4f4374-4af4-4f7e-972e-0b51e2b602ca req-cac46347-7cda-4f93-b083-42e6a8cdb18d service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Received event network-changed-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:17:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-4a4f4374-4af4-4f7e-972e-0b51e2b602ca req-cac46347-7cda-4f93-b083-42e6a8cdb18d service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Refreshing instance network info cache due to event network-changed-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:17:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4a4f4374-4af4-4f7e-972e-0b51e2b602ca req-cac46347-7cda-4f93-b083-42e6a8cdb18d service nova] Acquiring lock "refresh_cache-138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:17:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4a4f4374-4af4-4f7e-972e-0b51e2b602ca req-cac46347-7cda-4f93-b083-42e6a8cdb18d service nova] Acquired lock "refresh_cache-138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:17:48 user nova-compute[70645]: DEBUG nova.network.neutron [req-4a4f4374-4af4-4f7e-972e-0b51e2b602ca req-cac46347-7cda-4f93-b083-42e6a8cdb18d service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Refreshing network info cache for port b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:49 user nova-compute[70645]: INFO nova.compute.manager [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Terminating instance
Jul 24 15:17:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-4a4f4374-4af4-4f7e-972e-0b51e2b602ca req-cac46347-7cda-4f93-b083-42e6a8cdb18d service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Updated VIF entry in instance network info cache for port b93985ac-f66e-44ab-8c2a-7c6f266f5c4b. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-4a4f4374-4af4-4f7e-972e-0b51e2b602ca req-cac46347-7cda-4f93-b083-42e6a8cdb18d service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Updating instance_info_cache with network_info: [{"id": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "address": "fa:16:3e:0a:3f:2d", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93985ac-f6", "ovs_interfaceid": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4a4f4374-4af4-4f7e-972e-0b51e2b602ca req-cac46347-7cda-4f93-b083-42e6a8cdb18d service nova] Releasing lock "refresh_cache-138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Instance destroyed successfully.
Jul 24 15:17:49 user nova-compute[70645]: DEBUG nova.objects.instance [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'resources' on Instance uuid 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1878567581',display_name='tempest-AttachVolumeNegativeTest-server-1878567581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1878567581',id=40,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZlADAm9RRpCBh0YsWnEh6EeOUQeQBB4MrxSIeBSl0aH3I/qPHLH8dkpduaeVamak4JDzNgwjgtArfeYzziZFe3Z65PxFAzch9xpieZ4QH54x8RELivDz4pFZdoJgtDmg==',key_name='tempest-keypair-1132979618',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:16:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-45e8301c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:16:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "address": "fa:16:3e:0a:3f:2d", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93985ac-f6", "ovs_interfaceid": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "address": "fa:16:3e:0a:3f:2d", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93985ac-f6", "ovs_interfaceid": "b93985ac-f66e-44ab-8c2a-7c6f266f5c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=b93985ac-f66e-44ab-8c2a-7c6f266f5c4b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93985ac-f6') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG os_vif [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=b93985ac-f66e-44ab-8c2a-7c6f266f5c4b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93985ac-f6') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb93985ac-f6, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:17:49 user nova-compute[70645]: INFO os_vif [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=b93985ac-f66e-44ab-8c2a-7c6f266f5c4b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93985ac-f6')
Jul 24 15:17:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Deleting instance files /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b_del
Jul 24 15:17:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Deletion of /opt/stack/data/nova/instances/138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b_del complete
Jul 24 15:17:49 user nova-compute[70645]: INFO nova.compute.manager [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 24 15:17:49 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:17:49 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Received event network-vif-unplugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] Acquiring lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] No waiting events found dispatching network-vif-unplugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Received event network-vif-unplugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Received event network-vif-plugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] Acquiring lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] No waiting events found dispatching network-vif-plugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:17:50 user nova-compute[70645]: WARNING nova.compute.manager [req-12a0208b-4e83-47cf-b655-41b8418a1838 req-0fe3a262-bdf0-4eb1-8cc5-a36d417e25b4 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Received unexpected event network-vif-plugged-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b for instance with vm_state active and task_state deleting.
Jul 24 15:17:50 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:17:50 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Took 0.87 seconds to deallocate network for instance.
Jul 24 15:17:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-360badaf-f94b-48ab-b8a8-b82ddc9e13ee req-ff96bc9c-7d38-4559-b17f-be12af8a0576 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Received event network-vif-deleted-b93985ac-f66e-44ab-8c2a-7c6f266f5c4b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:17:50 user nova-compute[70645]: INFO nova.compute.manager [req-360badaf-f94b-48ab-b8a8-b82ddc9e13ee req-ff96bc9c-7d38-4559-b17f-be12af8a0576 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Neutron deleted interface b93985ac-f66e-44ab-8c2a-7c6f266f5c4b; detaching it from the instance and deleting it from the info cache
Jul 24 15:17:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-360badaf-f94b-48ab-b8a8-b82ddc9e13ee req-ff96bc9c-7d38-4559-b17f-be12af8a0576 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-360badaf-f94b-48ab-b8a8-b82ddc9e13ee req-ff96bc9c-7d38-4559-b17f-be12af8a0576 service nova] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Detach interface failed, port_id=b93985ac-f66e-44ab-8c2a-7c6f266f5c4b, reason: Instance 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:17:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:17:51 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:17:51 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:17:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:51 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Deleted allocations for instance 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b
Jul 24 15:17:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b0d9ddad-f833-46e0-b681-3359fd7579fd tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.184s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:17:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:17:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:04 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211869.828135, 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:18:04 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] VM Stopped (Lifecycle Event)
Jul 24 15:18:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-6b26a9b4-b14c-4fce-a368-60c7afaf6f22 None None] [instance: 138b282e-c7dc-45e5-94c8-3bbbc3d5bd4b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:18:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:18:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:18:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:18:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:18:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:18:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:18:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:32 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:18:33 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:35 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:35 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:37 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:18:37 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:18:37 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8257MB free_disk=25.19367218017578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 1372f999-32a0-4079-ab57-597093017d8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 47016839-ba35-418a-af61-d2b9ed1ffccc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 936cb284-e0df-4640-ad6a-9719d334a26c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 299bd8c5-7663-46b5-a37e-ff2716ceec83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 382ff84d-d789-42fc-8b21-d848b9978da5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:18:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:38 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:18:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 15:18:38 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:38 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:38 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:38 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:38 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 15:18:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] There are 0 instances to clean {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 15:18:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:40 user nova-compute[70645]: INFO nova.compute.manager [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Terminating instance
Jul 24 15:18:40 user nova-compute[70645]: DEBUG nova.compute.manager [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "936cb284-e0df-4640-ad6a-9719d334a26c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:40 user nova-compute[70645]: INFO nova.compute.manager [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Detaching volume 215bf4f9-db4a-470c-b979-ddb7844036f8
Jul 24 15:18:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:40 user nova-compute[70645]: INFO nova.virt.block_device [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Attempting to driver detach volume 215bf4f9-db4a-470c-b979-ddb7844036f8 from mountpoint /dev/vdb
Jul 24 15:18:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Attempting to detach device vdb from instance 936cb284-e0df-4640-ad6a-9719d334a26c from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:18:40 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:18:40 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:18:40 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:18:40 user nova-compute[70645]:   <serial>215bf4f9-db4a-470c-b979-ddb7844036f8</serial>
Jul 24 15:18:40 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:18:40 user nova-compute[70645]: </disk>
Jul 24 15:18:40 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:40 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully detached device vdb from instance 936cb284-e0df-4640-ad6a-9719d334a26c from the persistent domain config.
Jul 24 15:18:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 936cb284-e0df-4640-ad6a-9719d334a26c from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:18:40 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:18:40 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:18:40 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:18:40 user nova-compute[70645]:   <serial>215bf4f9-db4a-470c-b979-ddb7844036f8</serial>
Jul 24 15:18:40 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:18:40 user nova-compute[70645]: </disk>
Jul 24 15:18:40 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-bad7af01-e4e6-45d6-866f-f7ad4fcaee55 req-a81b3281-5e28-4193-be1e-7ae3c9d22042 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-unplugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bad7af01-e4e6-45d6-866f-f7ad4fcaee55 req-a81b3281-5e28-4193-be1e-7ae3c9d22042 service nova] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bad7af01-e4e6-45d6-866f-f7ad4fcaee55 req-a81b3281-5e28-4193-be1e-7ae3c9d22042 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bad7af01-e4e6-45d6-866f-f7ad4fcaee55 req-a81b3281-5e28-4193-be1e-7ae3c9d22042 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-bad7af01-e4e6-45d6-866f-f7ad4fcaee55 req-a81b3281-5e28-4193-be1e-7ae3c9d22042 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] No waiting events found dispatching network-vif-unplugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-bad7af01-e4e6-45d6-866f-f7ad4fcaee55 req-a81b3281-5e28-4193-be1e-7ae3c9d22042 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-unplugged-4dee8450-99dd-4a74-b710-6760a5a94e79 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211921.3553188, 936cb284-e0df-4640-ad6a-9719d334a26c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 936cb284-e0df-4640-ad6a-9719d334a26c {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:18:41 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully detached device vdb from instance 936cb284-e0df-4640-ad6a-9719d334a26c from the live domain config.
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CngHrKlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:18:41 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[27688f8e-c2f1-42e6-81cd-3ed8db1c6771]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a19fb61-3ab4-4c6f-908d-8d09d15d5b85]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:18:41 user nova-compute[70645]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:18:41 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 (non-flash)
Jul 24 15:18:41 user nova-compute[70645]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:18:41 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba845ed5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ae7433-84ac-4e82-af03-5d7c85bf45d7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b521eba-8df6-47de-a513-a3f8b0d0f03f]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5b5cc8-7467-4e48-b070-08e4a8067adf]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fd38d2-5a73-43d9-b108-9f68ebab9c7c]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8009e0e1-991e-4976-9413-658a520d3d41]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3551c83d-8aa0-416b-a97e-fe6bf77fba1b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8, portal: 172.16.0.220,3260]
Jul 24 15:18:41 user nova-compute[70645]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8, portal: 172.16.0.220,3260] successful.
Jul 24 15:18:41 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215bf4f9-db4a-470c-b979-ddb7844036f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6879054-ccf1-4ae7-a9fe-0a4f1f0833d4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] <== disconnect_volume: return (281ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:41 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Instance destroyed successfully.
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.objects.instance [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'resources' on Instance uuid 1372f999-32a0-4079-ab57-597093017d8b {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-424672047',display_name='tempest-TestMinimumBasicScenario-server-424672047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-424672047',id=36,image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMCo6QZiJchQhXRrPHIyCnOnnbjhZeUgUNG+32wdjxCdvlCaRVoEBgBdjGF7809Qm8W4trKXOzuU4MYrdfJ22pUeuIEmUyKnM5PXOk3q1rOao/NPluVjCFlULEzSwPC6Q==',key_name='tempest-TestMinimumBasicScenario-976160831',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:13:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2699829f2bd4b638132ea38a8f28b13',ramdisk_id='',reservation_id='r-81kts241',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3135bff3-0df2-4a5e-ab94-eb5dd2f182b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-55837010',owner_user_name='tempest-TestMinimumBasicScenario-55837010-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:16:01Z,user_data=None,user_id='782bcf41be0f4fcf881d467649ef5206',uuid=1372f999-32a0-4079-ab57-597093017d8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converting VIF {"id": "4dee8450-99dd-4a74-b710-6760a5a94e79", "address": "fa:16:3e:ce:ee:14", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dee8450-99", "ovs_interfaceid": "4dee8450-99dd-4a74-b710-6760a5a94e79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG os_vif [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dee8450-99, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:41 user nova-compute[70645]: INFO os_vif [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ee:14,bridge_name='br-int',has_traffic_filtering=True,id=4dee8450-99dd-4a74-b710-6760a5a94e79,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dee8450-99')
Jul 24 15:18:41 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Deleting instance files /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b_del
Jul 24 15:18:41 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Deletion of /opt/stack/data/nova/instances/1372f999-32a0-4079-ab57-597093017d8b_del complete
Jul 24 15:18:41 user nova-compute[70645]: INFO nova.compute.manager [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Took 1.06 seconds to destroy the instance on the hypervisor.
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 1372f999-32a0-4079-ab57-597093017d8b] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:18:41 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:42 user nova-compute[70645]: DEBUG nova.objects.instance [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'flavor' on Instance uuid 936cb284-e0df-4640-ad6a-9719d334a26c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:18:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-87f73982-8128-47e4-b8a4-fc1c3214ec73 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.809s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:42 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] No waiting events found dispatching network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:18:43 user nova-compute[70645]: WARNING nova.compute.manager [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received unexpected event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 for instance with vm_state active and task_state deleting.
Jul 24 15:18:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] No waiting events found dispatching network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:18:43 user nova-compute[70645]: WARNING nova.compute.manager [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received unexpected event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 for instance with vm_state active and task_state deleting.
Jul 24 15:18:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] No waiting events found dispatching network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:18:43 user nova-compute[70645]: WARNING nova.compute.manager [req-0fe1544d-bb6c-4aea-8d8f-704bbd76f5b1 req-4caa442f-3cf2-45e0-9eaa-3d93dfd5219f service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received unexpected event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 for instance with vm_state active and task_state deleting.
Jul 24 15:18:43 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:18:43 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Took 1.36 seconds to deallocate network for instance.
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:43 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Deleted allocations for instance 1372f999-32a0-4079-ab57-597093017d8b
Jul 24 15:18:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a19236e0-ad7a-473f-abbe-322d1d10fe4b tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "1372f999-32a0-4079-ab57-597093017d8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.177s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-4eb038c5-6144-4f9a-b929-f00c83fe9731 req-9cdcd06f-5f48-4d55-8642-0c8c859e3853 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-deleted-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:18:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-4eb038c5-6144-4f9a-b929-f00c83fe9731 req-9cdcd06f-5f48-4d55-8642-0c8c859e3853 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:18:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4eb038c5-6144-4f9a-b929-f00c83fe9731 req-9cdcd06f-5f48-4d55-8642-0c8c859e3853 service nova] Acquiring lock "1372f999-32a0-4079-ab57-597093017d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4eb038c5-6144-4f9a-b929-f00c83fe9731 req-9cdcd06f-5f48-4d55-8642-0c8c859e3853 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4eb038c5-6144-4f9a-b929-f00c83fe9731 req-9cdcd06f-5f48-4d55-8642-0c8c859e3853 service nova] Lock "1372f999-32a0-4079-ab57-597093017d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-4eb038c5-6144-4f9a-b929-f00c83fe9731 req-9cdcd06f-5f48-4d55-8642-0c8c859e3853 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] No waiting events found dispatching network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:18:45 user nova-compute[70645]: WARNING nova.compute.manager [req-4eb038c5-6144-4f9a-b929-f00c83fe9731 req-9cdcd06f-5f48-4d55-8642-0c8c859e3853 service nova] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Received unexpected event network-vif-plugged-4dee8450-99dd-4a74-b710-6760a5a94e79 for instance with vm_state deleted and task_state None.
Jul 24 15:18:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG nova.objects.instance [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'flavor' on Instance uuid 299bd8c5-7663-46b5-a37e-ff2716ceec83 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:47 user nova-compute[70645]: INFO nova.compute.manager [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Attaching volume 16a0d128-7758-4554-9fd2-c6f0a6e1477c to /dev/vdb
Jul 24 15:18:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-67abcbfc-76a1-43f1-a7cf-70c91950cb40 req-881e8d77-753c-4c39-9454-3a201b2ed00a service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received event network-changed-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-67abcbfc-76a1-43f1-a7cf-70c91950cb40 req-881e8d77-753c-4c39-9454-3a201b2ed00a service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Refreshing instance network info cache due to event network-changed-9289b0af-721b-4957-b8be-ccd34c289acf. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-67abcbfc-76a1-43f1-a7cf-70c91950cb40 req-881e8d77-753c-4c39-9454-3a201b2ed00a service nova] Acquiring lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-67abcbfc-76a1-43f1-a7cf-70c91950cb40 req-881e8d77-753c-4c39-9454-3a201b2ed00a service nova] Acquired lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-67abcbfc-76a1-43f1-a7cf-70c91950cb40 req-881e8d77-753c-4c39-9454-3a201b2ed00a service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Refreshing network info cache for port 9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG os_brick.utils [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5287f73-d2dd-46c2-8987-1b450884ba1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb7b7f2-f0af-4c96-8f6c-5170c12a77a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd050a69-ae3d-419d-9a6c-f7ef68703b4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ccad08-ef58-4058-b592-a8badaf74175]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:18:47 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cf1af3-012b-4715-8d68-a0d098d658f6]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG os_brick.utils [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Updating existing volume attachment record: 0728b91a-24f7-43a2-a8b0-4891aebc629c {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-67abcbfc-76a1-43f1-a7cf-70c91950cb40 req-881e8d77-753c-4c39-9454-3a201b2ed00a service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Updated VIF entry in instance network info cache for port 9289b0af-721b-4957-b8be-ccd34c289acf. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-67abcbfc-76a1-43f1-a7cf-70c91950cb40 req-881e8d77-753c-4c39-9454-3a201b2ed00a service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Updating instance_info_cache with network_info: [{"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:18:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-67abcbfc-76a1-43f1-a7cf-70c91950cb40 req-881e8d77-753c-4c39-9454-3a201b2ed00a service nova] Releasing lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:18:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:18:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyuMhwdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:18:53 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:18:53 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:18:53 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[25562e2f-f861-4cbd-aaff-3e5b93df055b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:18:53 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[af994630-ea7a-40f9-b261-7530e3ebf432]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c] added
Jul 24 15:18:53 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[489cbf79-af11-4230-8ded-fadd3d522fa1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fb26e9-2fc9-4c48-ab6d-cc5d60091c9f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FyuMhwdQ {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FyuMhwdQ" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[64805758-32aa-4957-bfbd-130acb2fe9b5]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FyuMhwdQ'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2315e437-6d80-4ff4-b0e9-7a9d4cde5d25]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bba1de-0803-4c0e-905a-f14c92e9f650]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:18:53 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:18:53 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a03f499-256f-4e5a-be58-65942652591b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c, portal: 172.16.0.220,3260]
Jul 24 15:18:53 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c, portal: 172.16.0.220,3260] successful.
Jul 24 15:18:53 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eea1bab-2095-4e16-8b08-52d8b7b2c05e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb6c78d-028b-46f7-b4ee-23cd25345715]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:18:53 user nova-compute[70645]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c (non-flash)
Jul 24 15:18:53 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:18:53 user nova-compute[70645]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c (non-flash)
Jul 24 15:18:53 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4522f8-1e1d-440a-a62b-006e2b1c20c9]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:53 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:18:54 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:18:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyuMhwdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:18:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:18:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26163373163643434', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:18:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163373163643434', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:18:54 user nova-compute[70645]: DEBUG nova.objects.instance [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'flavor' on Instance uuid 299bd8c5-7663-46b5-a37e-ff2716ceec83 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:18:54 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:18:54 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:18:54 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:18:54 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:18:54 user nova-compute[70645]:   <serial>16a0d128-7758-4554-9fd2-c6f0a6e1477c</serial>
Jul 24 15:18:54 user nova-compute[70645]: </disk>
Jul 24 15:18:54 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:18:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:18:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:18:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] No VIF found with MAC fa:16:3e:5b:1b:52, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:18:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b7d9027f-7880-470c-98e2-55277ce19e4f tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.060s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:56 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211921.6962729, 1372f999-32a0-4079-ab57-597093017d8b => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:18:56 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 1372f999-32a0-4079-ab57-597093017d8b] VM Stopped (Lifecycle Event)
Jul 24 15:18:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-98bbe027-6db3-4138-90f2-89559e10807c None None] [instance: 1372f999-32a0-4079-ab57-597093017d8b] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:18:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:18:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:18:56 user nova-compute[70645]: INFO nova.compute.manager [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Detaching volume 16a0d128-7758-4554-9fd2-c6f0a6e1477c
Jul 24 15:18:56 user nova-compute[70645]: INFO nova.virt.block_device [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Attempting to driver detach volume 16a0d128-7758-4554-9fd2-c6f0a6e1477c from mountpoint /dev/vdb
Jul 24 15:18:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Attempting to detach device vdb from instance 299bd8c5-7663-46b5-a37e-ff2716ceec83 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:18:57 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:18:57 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:18:57 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:18:57 user nova-compute[70645]:   <serial>16a0d128-7758-4554-9fd2-c6f0a6e1477c</serial>
Jul 24 15:18:57 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:18:57 user nova-compute[70645]: </disk>
Jul 24 15:18:57 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:18:57 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Successfully detached device vdb from instance 299bd8c5-7663-46b5-a37e-ff2716ceec83 from the persistent domain config.
Jul 24 15:18:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 299bd8c5-7663-46b5-a37e-ff2716ceec83 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:18:57 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:18:57 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:18:57 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:18:57 user nova-compute[70645]:   <serial>16a0d128-7758-4554-9fd2-c6f0a6e1477c</serial>
Jul 24 15:18:57 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:18:57 user nova-compute[70645]: </disk>
Jul 24 15:18:57 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690211937.4270065, 299bd8c5-7663-46b5-a37e-ff2716ceec83 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 299bd8c5-7663-46b5-a37e-ff2716ceec83 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:18:57 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Successfully detached device vdb from instance 299bd8c5-7663-46b5-a37e-ff2716ceec83 from the live domain config.
Jul 24 15:18:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyuMhwdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:18:57 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fd58f4-7c58-4546-8e3b-03f8a206ac19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a57a3e-ae52-486b-a9b6-792426415a2d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:18:57 user nova-compute[70645]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c (non-flash)
Jul 24 15:18:57 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:18:57 user nova-compute[70645]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c (non-flash)
Jul 24 15:18:57 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba84226950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8054ef-0156-43bf-9355-9a83b49aa377]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e70aad-ed66-4c0e-83df-c794347072e0]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3e96df-181a-40a0-81ae-904191986e50]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aaf044-2e87-407f-8bcc-6edcafe130ee]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a48fdf-2ee7-4763-9b04-e85d14429c24]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21d45ab-cb23-4994-9015-c376080fc2ff]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c, portal: 172.16.0.220,3260]
Jul 24 15:18:57 user nova-compute[70645]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c, portal: 172.16.0.220,3260] successful.
Jul 24 15:18:57 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a0d128-7758-4554-9fd2-c6f0a6e1477c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a440a050-d084-49fb-8b02-f325eccb25c7]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] <== disconnect_volume: return (261ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:18:57 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:18:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:18:58 user nova-compute[70645]: DEBUG nova.objects.instance [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'flavor' on Instance uuid 299bd8c5-7663-46b5-a37e-ff2716ceec83 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:18:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-60b44ba3-e040-4972-9200-61bac751cfe2 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.534s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:18:59 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:00 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:00 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70645) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 15:19:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "382ff84d-d789-42fc-8b21-d848b9978da5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "382ff84d-d789-42fc-8b21-d848b9978da5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:10 user nova-compute[70645]: INFO nova.compute.manager [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Terminating instance
Jul 24 15:19:10 user nova-compute[70645]: DEBUG nova.compute.manager [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-da422b2c-3def-4018-a293-a976f5cd7d90 req-6be740ef-4b10-4a39-aa47-6e2fd2502950 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Received event network-vif-unplugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-da422b2c-3def-4018-a293-a976f5cd7d90 req-6be740ef-4b10-4a39-aa47-6e2fd2502950 service nova] Acquiring lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-da422b2c-3def-4018-a293-a976f5cd7d90 req-6be740ef-4b10-4a39-aa47-6e2fd2502950 service nova] Lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-da422b2c-3def-4018-a293-a976f5cd7d90 req-6be740ef-4b10-4a39-aa47-6e2fd2502950 service nova] Lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-da422b2c-3def-4018-a293-a976f5cd7d90 req-6be740ef-4b10-4a39-aa47-6e2fd2502950 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] No waiting events found dispatching network-vif-unplugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:19:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-da422b2c-3def-4018-a293-a976f5cd7d90 req-6be740ef-4b10-4a39-aa47-6e2fd2502950 service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Received event network-vif-unplugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:19:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Instance destroyed successfully.
Jul 24 15:19:11 user nova-compute[70645]: DEBUG nova.objects.instance [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'resources' on Instance uuid 382ff84d-d789-42fc-8b21-d848b9978da5 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-762083338',display_name='tempest-TestVolumeBootPattern-server-762083338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-762083338',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-z0m6dqll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:17:38Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=382ff84d-d789-42fc-8b21-d848b9978da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "address": "fa:16:3e:9b:4a:44", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a28b840-b7", "ovs_interfaceid": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "address": "fa:16:3e:9b:4a:44", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a28b840-b7", "ovs_interfaceid": "7a28b840-b759-42dc-ad11-a3214ebf9bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4a:44,bridge_name='br-int',has_traffic_filtering=True,id=7a28b840-b759-42dc-ad11-a3214ebf9bb9,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a28b840-b7') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_vif [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4a:44,bridge_name='br-int',has_traffic_filtering=True,id=7a28b840-b759-42dc-ad11-a3214ebf9bb9,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a28b840-b7') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a28b840-b7, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:11 user nova-compute[70645]: INFO os_vif [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4a:44,bridge_name='br-int',has_traffic_filtering=True,id=7a28b840-b759-42dc-ad11-a3214ebf9bb9,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a28b840-b7')
Jul 24 15:19:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuJARgVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:19:11 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e200a007-f354-45c5-9a59-6a3e53b4d0cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d26afeb-0a88-4cde-a313-e7545257a3ad]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:19:11 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 (non-flash)
Jul 24 15:19:11 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba845eca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77'): ({'sdd'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Removing single pathed devices sdd {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa32f9d-3206-4593-9d7e-cdbc45faf569]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1378b0dd-0c9c-4338-ba24-3670a429bc7d]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flushing IO for device /dev/sdd {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ef4d84-ce2e-492e-ab46-5e882af1cf4d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[23abfb30-fd7b-46d9-965a-b5eab4951866]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23934303864633335', '/dev/disk/by-id/scsi-1SCST_BIO7ec58510-9408dc35d26f5cc1', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7ec58510') {{(pid=81509) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[56132f57-0c44-4418-bd52-50856cbe3c3c]: (4, None) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffb356e-a06f-4cde-9b95-85675ddd3c89]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee18ece1-d600-4d54-b6a3-42851f468054]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77, portal: 172.16.0.220,3260]
Jul 24 15:19:11 user nova-compute[70645]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77, portal: 172.16.0.220,3260] successful.
Jul 24 15:19:11 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0152744d-5061-4247-8e69-0c9b6277fe77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2485282-ddd0-407d-91fe-5d761166e9b4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== disconnect_volume: return (280ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:19:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Deleting instance files /opt/stack/data/nova/instances/382ff84d-d789-42fc-8b21-d848b9978da5_del
Jul 24 15:19:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Deletion of /opt/stack/data/nova/instances/382ff84d-d789-42fc-8b21-d848b9978da5_del complete
Jul 24 15:19:11 user nova-compute[70645]: INFO nova.compute.manager [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 24 15:19:11 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:19:11 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:19:12 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:19:12 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Took 0.45 seconds to deallocate network for instance.
Jul 24 15:19:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-4e29499f-8e47-4691-a2c9-b0f44c0b0a73 req-c2f17dd5-8aa1-4555-aa63-02bd13a5dc3d service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Received event network-vif-plugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4e29499f-8e47-4691-a2c9-b0f44c0b0a73 req-c2f17dd5-8aa1-4555-aa63-02bd13a5dc3d service nova] Acquiring lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4e29499f-8e47-4691-a2c9-b0f44c0b0a73 req-c2f17dd5-8aa1-4555-aa63-02bd13a5dc3d service nova] Lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4e29499f-8e47-4691-a2c9-b0f44c0b0a73 req-c2f17dd5-8aa1-4555-aa63-02bd13a5dc3d service nova] Lock "382ff84d-d789-42fc-8b21-d848b9978da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-4e29499f-8e47-4691-a2c9-b0f44c0b0a73 req-c2f17dd5-8aa1-4555-aa63-02bd13a5dc3d service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] No waiting events found dispatching network-vif-plugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:19:12 user nova-compute[70645]: WARNING nova.compute.manager [req-4e29499f-8e47-4691-a2c9-b0f44c0b0a73 req-c2f17dd5-8aa1-4555-aa63-02bd13a5dc3d service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Received unexpected event network-vif-plugged-7a28b840-b759-42dc-ad11-a3214ebf9bb9 for instance with vm_state active and task_state deleting.
Jul 24 15:19:12 user nova-compute[70645]: DEBUG nova.compute.manager [req-4e29499f-8e47-4691-a2c9-b0f44c0b0a73 req-c2f17dd5-8aa1-4555-aa63-02bd13a5dc3d service nova] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Received event network-vif-deleted-7a28b840-b759-42dc-ad11-a3214ebf9bb9 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:13 user nova-compute[70645]: INFO nova.compute.manager [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Took 0.89 seconds to detach 1 volumes for instance.
Jul 24 15:19:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Deleting volume: 0152744d-5061-4247-8e69-0c9b6277fe77 {{(pid=70645) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 15:19:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:13 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:19:13 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:19:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:13 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Deleted allocations for instance 382ff84d-d789-42fc-8b21-d848b9978da5
Jul 24 15:19:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-21cff4ef-13f2-4282-9490-01bf18d4b96e tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "382ff84d-d789-42fc-8b21-d848b9978da5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.885s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 47016839-ba35-418a-af61-d2b9ed1ffccc {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 936cb284-e0df-4640-ad6a-9719d334a26c {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 299bd8c5-7663-46b5-a37e-ff2716ceec83 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "47016839-ba35-418a-af61-d2b9ed1ffccc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "936cb284-e0df-4640-ad6a-9719d334a26c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:19:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:26 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211951.2804523, 382ff84d-d789-42fc-8b21-d848b9978da5 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:19:26 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] VM Stopped (Lifecycle Event)
Jul 24 15:19:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-c4bd6ec8-8d78-468d-9254-016736ae4f4d None None] [instance: 382ff84d-d789-42fc-8b21-d848b9978da5] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:19:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "936cb284-e0df-4640-ad6a-9719d334a26c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:30 user nova-compute[70645]: INFO nova.compute.manager [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Terminating instance
Jul 24 15:19:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-97c75540-7c68-4aa8-bdca-79fd13696de9 req-4ee45fb6-4df9-46bb-8e92-7740ddfb2843 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Received event network-vif-unplugged-b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-97c75540-7c68-4aa8-bdca-79fd13696de9 req-4ee45fb6-4df9-46bb-8e92-7740ddfb2843 service nova] Acquiring lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-97c75540-7c68-4aa8-bdca-79fd13696de9 req-4ee45fb6-4df9-46bb-8e92-7740ddfb2843 service nova] Lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-97c75540-7c68-4aa8-bdca-79fd13696de9 req-4ee45fb6-4df9-46bb-8e92-7740ddfb2843 service nova] Lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-97c75540-7c68-4aa8-bdca-79fd13696de9 req-4ee45fb6-4df9-46bb-8e92-7740ddfb2843 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] No waiting events found dispatching network-vif-unplugged-b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG nova.compute.manager [req-97c75540-7c68-4aa8-bdca-79fd13696de9 req-4ee45fb6-4df9-46bb-8e92-7740ddfb2843 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Received event network-vif-unplugged-b3256b72-7d12-4211-af7c-8c3309af4b3b for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:19:31 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Instance destroyed successfully.
Jul 24 15:19:31 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'resources' on Instance uuid 936cb284-e0df-4640-ad6a-9719d334a26c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1039009520',display_name='tempest-AttachVolumeNegativeTest-server-1039009520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1039009520',id=38,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh/JZ3YxLZ5fvpdm1Uo19kj4TE2PMVgkdngKCZzySwQKZ9gkap4gWcTWkpN8EhS29LH18A/u4J+mheHTw1k7ZsT0Yb38KaRqxcu65QlRIw2hVrsPSEz9re174lxKV0Aqg==',key_name='tempest-keypair-405716000',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-0i0krm5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=936cb284-e0df-4640-ad6a-9719d334a26c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "address": "fa:16:3e:68:d7:02", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3256b72-7d", "ovs_interfaceid": "b3256b72-7d12-4211-af7c-8c3309af4b3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=b3256b72-7d12-4211-af7c-8c3309af4b3b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3256b72-7d') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG os_vif [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=b3256b72-7d12-4211-af7c-8c3309af4b3b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3256b72-7d') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3256b72-7d, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:19:31 user nova-compute[70645]: INFO os_vif [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=b3256b72-7d12-4211-af7c-8c3309af4b3b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3256b72-7d')
Jul 24 15:19:31 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Deleting instance files /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c_del
Jul 24 15:19:31 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Deletion of /opt/stack/data/nova/instances/936cb284-e0df-4640-ad6a-9719d334a26c_del complete
Jul 24 15:19:31 user nova-compute[70645]: INFO nova.compute.manager [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 24 15:19:31 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:19:31 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:19:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:32 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:19:32 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Took 1.03 seconds to deallocate network for instance.
Jul 24 15:19:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-e974ac70-9cb4-4a33-a800-71599cae5b0f req-14d50c20-205e-41a1-939d-896da456d006 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Received event network-vif-deleted-b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:33 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:19:33 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:19:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:33 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Deleted allocations for instance 936cb284-e0df-4640-ad6a-9719d334a26c
Jul 24 15:19:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0f0b6057-3c47-4f63-92fd-3673a103aedc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "936cb284-e0df-4640-ad6a-9719d334a26c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.436s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-8323a0dd-efe2-4727-a031-45f14c248341 req-8a7d7cf6-c7cf-47d5-a1bb-da930b940fc5 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Received event network-vif-plugged-b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8323a0dd-efe2-4727-a031-45f14c248341 req-8a7d7cf6-c7cf-47d5-a1bb-da930b940fc5 service nova] Acquiring lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8323a0dd-efe2-4727-a031-45f14c248341 req-8a7d7cf6-c7cf-47d5-a1bb-da930b940fc5 service nova] Lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8323a0dd-efe2-4727-a031-45f14c248341 req-8a7d7cf6-c7cf-47d5-a1bb-da930b940fc5 service nova] Lock "936cb284-e0df-4640-ad6a-9719d334a26c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-8323a0dd-efe2-4727-a031-45f14c248341 req-8a7d7cf6-c7cf-47d5-a1bb-da930b940fc5 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] No waiting events found dispatching network-vif-plugged-b3256b72-7d12-4211-af7c-8c3309af4b3b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:19:33 user nova-compute[70645]: WARNING nova.compute.manager [req-8323a0dd-efe2-4727-a031-45f14c248341 req-8a7d7cf6-c7cf-47d5-a1bb-da930b940fc5 service nova] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Received unexpected event network-vif-plugged-b3256b72-7d12-4211-af7c-8c3309af4b3b for instance with vm_state deleted and task_state None.
Jul 24 15:19:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:19:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:34 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:34 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:19:34 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:19:34 user nova-compute[70645]: INFO nova.compute.claims [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Claim successful on node user
Jul 24 15:19:34 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Refreshing inventories for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Updating ProviderTree inventory for provider a0cf5b80-69d2-4191-894e-a498eab7d688 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Refreshing aggregate associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, aggregates: None {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Refreshing trait associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.network.neutron [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:19:35 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.policy [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '782bcf41be0f4fcf881d467649ef5206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2699829f2bd4b638132ea38a8f28b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:19:35 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Creating image(s)
Jul 24 15:19:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "/opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "/opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "f9641ff92f4c660b6ae9c2e637e50d03a612943d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "f9641ff92f4c660b6ae9c2e637e50d03a612943d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d.part --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG nova.network.neutron [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Successfully created port: c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d.part --force-share --output=json" returned: 0 in 0.203s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG nova.virt.images [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] def31d05-c06f-4c0e-b00a-b137119b8694 was qcow2, converting to raw {{(pid=70645) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG nova.privsep.utils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70645) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d.part /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d.converted {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d.part /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d.converted" returned: 0 in 0.552s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d.converted --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "f9641ff92f4c660b6ae9c2e637e50d03a612943d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.484s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d --force-share --output=json" returned: 0 in 0.164s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "f9641ff92f4c660b6ae9c2e637e50d03a612943d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "f9641ff92f4c660b6ae9c2e637e50d03a612943d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d,backing_fmt=raw /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d,backing_fmt=raw /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk 1073741824" returned: 0 in 0.046s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "f9641ff92f4c660b6ae9c2e637e50d03a612943d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG nova.network.neutron [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Successfully updated port: c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquired lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG nova.network.neutron [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-437c9dc0-a0c0-411c-ad57-5b20de71028b req-b77d64b2-c43c-4439-81ed-3e9fbc48f2fa service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-changed-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG nova.compute.manager [req-437c9dc0-a0c0-411c-ad57-5b20de71028b req-b77d64b2-c43c-4439-81ed-3e9fbc48f2fa service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Refreshing instance network info cache due to event network-changed-c49723c2-20d7-4b28-b6df-d23b9af56066. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-437c9dc0-a0c0-411c-ad57-5b20de71028b req-b77d64b2-c43c-4439-81ed-3e9fbc48f2fa service nova] Acquiring lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG nova.network.neutron [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Cannot resize image /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG nova.objects.instance [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'migration_context' on Instance uuid fa864eae-0ab7-4009-bd0c-b376075b1b2a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Ensure instance console log exists: /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:19:38 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:19:38 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8621MB free_disk=25.22652816772461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.network.neutron [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updating instance_info_cache with network_info: [{"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Releasing lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Instance network_info: |[{"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-437c9dc0-a0c0-411c-ad57-5b20de71028b req-b77d64b2-c43c-4439-81ed-3e9fbc48f2fa service nova] Acquired lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.network.neutron [req-437c9dc0-a0c0-411c-ad57-5b20de71028b req-b77d64b2-c43c-4439-81ed-3e9fbc48f2fa service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Refreshing network info cache for port c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Start _get_guest_xml network_info=[{"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T15:19:32Z,direct_url=<?>,disk_format='qcow2',id=def31d05-c06f-4c0e-b00a-b137119b8694,min_disk=0,min_ram=0,name='tempest-scenario-img--962402043',owner='b2699829f2bd4b638132ea38a8f28b13',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T15:19:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'def31d05-c06f-4c0e-b00a-b137119b8694'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:19:38 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:19:38 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 47016839-ba35-418a-af61-d2b9ed1ffccc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 299bd8c5-7663-46b5-a37e-ff2716ceec83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance fa864eae-0ab7-4009-bd0c-b376075b1b2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T15:19:32Z,direct_url=<?>,disk_format='qcow2',id=def31d05-c06f-4c0e-b00a-b137119b8694,min_disk=0,min_ram=0,name='tempest-scenario-img--962402043',owner='b2699829f2bd4b638132ea38a8f28b13',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T15:19:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:19:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1197085571',display_name='tempest-TestMinimumBasicScenario-server-1197085571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1197085571',id=43,image_ref='def31d05-c06f-4c0e-b00a-b137119b8694',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2VyWR6BN6uVmHBE1Fe48Xsr4SthamiDiZHHpk5egwQ99QQ2tHdqcSJ/0BPH2Z42/1t0qf5XPa+CUb7dPp6McRSRw4/usDMJ8RkA/waJc4UTkOwhuoV0upYs3n0FZ0Sw==',key_name='tempest-TestMinimumBasicScenario-1740538353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2699829f2bd4b638132ea38a8f28b13',ramdisk_id='',reservation_id='r-aojtsxj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='def31d05-c06f-4c0e-b00a-b137119b8694',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-55837010',owner_user_name='tempest-TestMinimumBasicScenario-55837010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:19:35Z,user_data=None,user_id='782bcf41be0f4fcf881d467649ef5206',uuid=fa864eae-0ab7-4009-bd0c-b376075b1b2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converting VIF {"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:2d:15,bridge_name='br-int',has_traffic_filtering=True,id=c49723c2-20d7-4b28-b6df-d23b9af56066,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49723c2-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.objects.instance [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'pci_devices' on Instance uuid fa864eae-0ab7-4009-bd0c-b376075b1b2a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:19:38 user nova-compute[70645]:   <uuid>fa864eae-0ab7-4009-bd0c-b376075b1b2a</uuid>
Jul 24 15:19:38 user nova-compute[70645]:   <name>instance-0000002b</name>
Jul 24 15:19:38 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:19:38 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:19:38 user nova-compute[70645]:   <metadata>
Jul 24 15:19:38 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:19:38 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:19:38 user nova-compute[70645]:       <nova:name>tempest-TestMinimumBasicScenario-server-1197085571</nova:name>
Jul 24 15:19:38 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:19:38</nova:creationTime>
Jul 24 15:19:38 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:19:38 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:19:38 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:19:38 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:19:38 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:19:38 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:19:38 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:19:38 user nova-compute[70645]:       <nova:owner>
Jul 24 15:19:38 user nova-compute[70645]:         <nova:user uuid="782bcf41be0f4fcf881d467649ef5206">tempest-TestMinimumBasicScenario-55837010-project-member</nova:user>
Jul 24 15:19:38 user nova-compute[70645]:         <nova:project uuid="b2699829f2bd4b638132ea38a8f28b13">tempest-TestMinimumBasicScenario-55837010</nova:project>
Jul 24 15:19:38 user nova-compute[70645]:       </nova:owner>
Jul 24 15:19:38 user nova-compute[70645]:       <nova:root type="image" uuid="def31d05-c06f-4c0e-b00a-b137119b8694"/>
Jul 24 15:19:38 user nova-compute[70645]:       <nova:ports>
Jul 24 15:19:38 user nova-compute[70645]:         <nova:port uuid="c49723c2-20d7-4b28-b6df-d23b9af56066">
Jul 24 15:19:38 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 15:19:38 user nova-compute[70645]:         </nova:port>
Jul 24 15:19:38 user nova-compute[70645]:       </nova:ports>
Jul 24 15:19:38 user nova-compute[70645]:     </nova:instance>
Jul 24 15:19:38 user nova-compute[70645]:   </metadata>
Jul 24 15:19:38 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:19:38 user nova-compute[70645]:     <system>
Jul 24 15:19:38 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:19:38 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:19:38 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:19:38 user nova-compute[70645]:       <entry name="serial">fa864eae-0ab7-4009-bd0c-b376075b1b2a</entry>
Jul 24 15:19:38 user nova-compute[70645]:       <entry name="uuid">fa864eae-0ab7-4009-bd0c-b376075b1b2a</entry>
Jul 24 15:19:38 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:19:38 user nova-compute[70645]:     </system>
Jul 24 15:19:38 user nova-compute[70645]:   </sysinfo>
Jul 24 15:19:38 user nova-compute[70645]:   <os>
Jul 24 15:19:38 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:19:38 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:19:38 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:19:38 user nova-compute[70645]:   </os>
Jul 24 15:19:38 user nova-compute[70645]:   <features>
Jul 24 15:19:38 user nova-compute[70645]:     <acpi/>
Jul 24 15:19:38 user nova-compute[70645]:     <apic/>
Jul 24 15:19:38 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:19:38 user nova-compute[70645]:   </features>
Jul 24 15:19:38 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:19:38 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:19:38 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:19:38 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:19:38 user nova-compute[70645]:   </clock>
Jul 24 15:19:38 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:19:38 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:19:38 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:19:38 user nova-compute[70645]:   </cpu>
Jul 24 15:19:38 user nova-compute[70645]:   <devices>
Jul 24 15:19:38 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:19:38 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:19:38 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk"/>
Jul 24 15:19:38 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:19:38 user nova-compute[70645]:     </disk>
Jul 24 15:19:38 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:19:38 user nova-compute[70645]:       <mac address="fa:16:3e:2f:2d:15"/>
Jul 24 15:19:38 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:19:38 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:19:38 user nova-compute[70645]:       <target dev="tapc49723c2-20"/>
Jul 24 15:19:38 user nova-compute[70645]:     </interface>
Jul 24 15:19:38 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:19:38 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/console.log" append="off"/>
Jul 24 15:19:38 user nova-compute[70645]:     </serial>
Jul 24 15:19:38 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:19:38 user nova-compute[70645]:     <video>
Jul 24 15:19:38 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:19:38 user nova-compute[70645]:     </video>
Jul 24 15:19:38 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:19:38 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:19:38 user nova-compute[70645]:     </rng>
Jul 24 15:19:38 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:19:38 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:19:38 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:19:38 user nova-compute[70645]:     </memballoon>
Jul 24 15:19:38 user nova-compute[70645]:   </devices>
Jul 24 15:19:38 user nova-compute[70645]: </domain>
Jul 24 15:19:38 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:19:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1197085571',display_name='tempest-TestMinimumBasicScenario-server-1197085571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1197085571',id=43,image_ref='def31d05-c06f-4c0e-b00a-b137119b8694',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2VyWR6BN6uVmHBE1Fe48Xsr4SthamiDiZHHpk5egwQ99QQ2tHdqcSJ/0BPH2Z42/1t0qf5XPa+CUb7dPp6McRSRw4/usDMJ8RkA/waJc4UTkOwhuoV0upYs3n0FZ0Sw==',key_name='tempest-TestMinimumBasicScenario-1740538353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2699829f2bd4b638132ea38a8f28b13',ramdisk_id='',reservation_id='r-aojtsxj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='def31d05-c06f-4c0e-b00a-b137119b8694',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-55837010',owner_user_name='tempest-TestMinimumBasicScenario-55837010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:19:35Z,user_data=None,user_id='782bcf41be0f4fcf881d467649ef5206',uuid=fa864eae-0ab7-4009-bd0c-b376075b1b2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converting VIF {"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:2d:15,bridge_name='br-int',has_traffic_filtering=True,id=c49723c2-20d7-4b28-b6df-d23b9af56066,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49723c2-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG os_vif [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:2d:15,bridge_name='br-int',has_traffic_filtering=True,id=c49723c2-20d7-4b28-b6df-d23b9af56066,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49723c2-20') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc49723c2-20, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc49723c2-20, col_values=(('external_ids', {'iface-id': 'c49723c2-20d7-4b28-b6df-d23b9af56066', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:2d:15', 'vm-uuid': 'fa864eae-0ab7-4009-bd0c-b376075b1b2a'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:38 user nova-compute[70645]: INFO os_vif [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:2d:15,bridge_name='br-int',has_traffic_filtering=True,id=c49723c2-20d7-4b28-b6df-d23b9af56066,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49723c2-20')
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] No VIF found with MAC fa:16:3e:2f:2d:15, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.network.neutron [req-437c9dc0-a0c0-411c-ad57-5b20de71028b req-b77d64b2-c43c-4439-81ed-3e9fbc48f2fa service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updated VIF entry in instance network info cache for port c49723c2-20d7-4b28-b6df-d23b9af56066. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG nova.network.neutron [req-437c9dc0-a0c0-411c-ad57-5b20de71028b req-b77d64b2-c43c-4439-81ed-3e9fbc48f2fa service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updating instance_info_cache with network_info: [{"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:19:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-437c9dc0-a0c0-411c-ad57-5b20de71028b req-b77d64b2-c43c-4439-81ed-3e9fbc48f2fa service nova] Releasing lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Skipping network cache update for instance because it is Building. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 47016839-ba35-418a-af61-d2b9ed1ffccc {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-2a0a6d70-ccf4-427b-959e-ef1ab7071d47 req-c540b4ff-97a6-49de-9a73-6a310c095448 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2a0a6d70-ccf4-427b-959e-ef1ab7071d47 req-c540b4ff-97a6-49de-9a73-6a310c095448 service nova] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2a0a6d70-ccf4-427b-959e-ef1ab7071d47 req-c540b4ff-97a6-49de-9a73-6a310c095448 service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2a0a6d70-ccf4-427b-959e-ef1ab7071d47 req-c540b4ff-97a6-49de-9a73-6a310c095448 service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-2a0a6d70-ccf4-427b-959e-ef1ab7071d47 req-c540b4ff-97a6-49de-9a73-6a310c095448 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] No waiting events found dispatching network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:19:39 user nova-compute[70645]: WARNING nova.compute.manager [req-2a0a6d70-ccf4-427b-959e-ef1ab7071d47 req-c540b4ff-97a6-49de-9a73-6a310c095448 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received unexpected event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 for instance with vm_state building and task_state spawning.
Jul 24 15:19:40 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updating instance_info_cache with network_info: [{"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:19:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:19:40 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:19:40 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:40 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:40 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:40 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211981.6831303, fa864eae-0ab7-4009-bd0c-b376075b1b2a => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:19:41 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] VM Resumed (Lifecycle Event)
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:19:41 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Instance spawned successfully.
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:19:41 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690211981.686581, fa864eae-0ab7-4009-bd0c-b376075b1b2a => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:19:41 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] VM Started (Lifecycle Event)
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:19:41 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:19:41 user nova-compute[70645]: INFO nova.compute.manager [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Took 6.34 seconds to spawn the instance on the hypervisor.
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:19:41 user nova-compute[70645]: INFO nova.compute.manager [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Took 7.00 seconds to build instance.
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-19fd2025-49fa-491f-b654-cb894a6ed0cd req-4b1ddda9-f8cc-44b9-b18e-1e99ee2caac2 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-19fd2025-49fa-491f-b654-cb894a6ed0cd req-4b1ddda9-f8cc-44b9-b18e-1e99ee2caac2 service nova] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-19fd2025-49fa-491f-b654-cb894a6ed0cd req-4b1ddda9-f8cc-44b9-b18e-1e99ee2caac2 service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-19fd2025-49fa-491f-b654-cb894a6ed0cd req-4b1ddda9-f8cc-44b9-b18e-1e99ee2caac2 service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-19fd2025-49fa-491f-b654-cb894a6ed0cd req-4b1ddda9-f8cc-44b9-b18e-1e99ee2caac2 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] No waiting events found dispatching network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:19:41 user nova-compute[70645]: WARNING nova.compute.manager [req-19fd2025-49fa-491f-b654-cb894a6ed0cd req-4b1ddda9-f8cc-44b9-b18e-1e99ee2caac2 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received unexpected event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 for instance with vm_state active and task_state None.
Jul 24 15:19:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-793596bf-de4a-447a-8bf5-477ea0a78170 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.086s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:42 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:43 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:19:46 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211971.8209205, 936cb284-e0df-4640-ad6a-9719d334a26c => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:19:46 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] VM Stopped (Lifecycle Event)
Jul 24 15:19:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d4eb5481-f425-4a2c-b91a-5664ef48c48b None None] [instance: 936cb284-e0df-4640-ad6a-9719d334a26c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-f3b8c95d-0f88-4f28-b651-895fface383e req-0a5996cd-ab21-4983-8d04-2eb5eba1017d service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received event network-changed-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-f3b8c95d-0f88-4f28-b651-895fface383e req-0a5996cd-ab21-4983-8d04-2eb5eba1017d service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Refreshing instance network info cache due to event network-changed-9289b0af-721b-4957-b8be-ccd34c289acf. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f3b8c95d-0f88-4f28-b651-895fface383e req-0a5996cd-ab21-4983-8d04-2eb5eba1017d service nova] Acquiring lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f3b8c95d-0f88-4f28-b651-895fface383e req-0a5996cd-ab21-4983-8d04-2eb5eba1017d service nova] Acquired lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.network.neutron [req-f3b8c95d-0f88-4f28-b651-895fface383e req-0a5996cd-ab21-4983-8d04-2eb5eba1017d service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Refreshing network info cache for port 9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:48 user nova-compute[70645]: INFO nova.compute.manager [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Terminating instance
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-e253fbab-8d25-4f30-92cb-e895761f5fbf req-86941bba-73f2-49e9-ba04-41b9711a2b4c service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received event network-vif-unplugged-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e253fbab-8d25-4f30-92cb-e895761f5fbf req-86941bba-73f2-49e9-ba04-41b9711a2b4c service nova] Acquiring lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e253fbab-8d25-4f30-92cb-e895761f5fbf req-86941bba-73f2-49e9-ba04-41b9711a2b4c service nova] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e253fbab-8d25-4f30-92cb-e895761f5fbf req-86941bba-73f2-49e9-ba04-41b9711a2b4c service nova] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-e253fbab-8d25-4f30-92cb-e895761f5fbf req-86941bba-73f2-49e9-ba04-41b9711a2b4c service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] No waiting events found dispatching network-vif-unplugged-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-e253fbab-8d25-4f30-92cb-e895761f5fbf req-86941bba-73f2-49e9-ba04-41b9711a2b4c service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received event network-vif-unplugged-9289b0af-721b-4957-b8be-ccd34c289acf for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.network.neutron [req-f3b8c95d-0f88-4f28-b651-895fface383e req-0a5996cd-ab21-4983-8d04-2eb5eba1017d service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Updated VIF entry in instance network info cache for port 9289b0af-721b-4957-b8be-ccd34c289acf. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.network.neutron [req-f3b8c95d-0f88-4f28-b651-895fface383e req-0a5996cd-ab21-4983-8d04-2eb5eba1017d service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Updating instance_info_cache with network_info: [{"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f3b8c95d-0f88-4f28-b651-895fface383e req-0a5996cd-ab21-4983-8d04-2eb5eba1017d service nova] Releasing lock "refresh_cache-299bd8c5-7663-46b5-a37e-ff2716ceec83" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:19:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Instance destroyed successfully.
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.objects.instance [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'resources' on Instance uuid 299bd8c5-7663-46b5-a37e-ff2716ceec83 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-730711147',display_name='tempest-TestStampPattern-server-730711147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-730711147',id=41,image_ref='c3a6482c-db54-432d-9999-ec58f1ec3d38',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpaiR09gawF0BiABPWc5BhN+ZqJhKaACzOhcrf2boJj0UiD0Yx//+fQ+eBUaDKWD1VfnztdaIfJWCRQbiO7xZZ9eT9akk4tzJdcm5XEY3bK9HSekgcRSxxbsyrKUsbDHw==',key_name='tempest-TestStampPattern-922639899',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d61e837ad1e437fb8b9ebee58a2e228',ramdisk_id='',reservation_id='r-txfntuxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='47016839-ba35-418a-af61-d2b9ed1ffccc',image_min_disk='1',image_min_ram='0',image_owner_id='2d61e837ad1e437fb8b9ebee58a2e228',image_owner_project_name='tempest-TestStampPattern-63827052',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-63827052-project-member',image_user_id='00e9c5d73ac941ed8b67471058c3db0a',owner_project_name='tempest-TestStampPattern-63827052',owner_user_name='tempest-TestStampPattern-63827052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:17:03Z,user_data=None,user_id='00e9c5d73ac941ed8b67471058c3db0a',uuid=299bd8c5-7663-46b5-a37e-ff2716ceec83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converting VIF {"id": "9289b0af-721b-4957-b8be-ccd34c289acf", "address": "fa:16:3e:5b:1b:52", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9289b0af-72", "ovs_interfaceid": "9289b0af-721b-4957-b8be-ccd34c289acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=9289b0af-721b-4957-b8be-ccd34c289acf,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9289b0af-72') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG os_vif [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=9289b0af-721b-4957-b8be-ccd34c289acf,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9289b0af-72') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9289b0af-72, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:19:48 user nova-compute[70645]: INFO os_vif [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=9289b0af-721b-4957-b8be-ccd34c289acf,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9289b0af-72')
Jul 24 15:19:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Deleting instance files /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83_del
Jul 24 15:19:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Deletion of /opt/stack/data/nova/instances/299bd8c5-7663-46b5-a37e-ff2716ceec83_del complete
Jul 24 15:19:48 user nova-compute[70645]: INFO nova.compute.manager [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 24 15:19:48 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:19:48 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:19:49 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:19:49 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Took 0.46 seconds to deallocate network for instance.
Jul 24 15:19:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-115c2140-f7e0-47c8-834e-33ac35983527 req-03bf67bb-4af6-4735-a41d-11bca55c616c service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received event network-vif-deleted-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:49 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:19:49 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:19:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:49 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Deleted allocations for instance 299bd8c5-7663-46b5-a37e-ff2716ceec83
Jul 24 15:19:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0423497c-4bb5-4385-81a1-7fa696af0165 tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.622s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-0150fe17-43da-4089-8536-873507771f56 req-4992465b-453f-4330-94b6-4f361510e83e service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received event network-vif-plugged-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:19:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0150fe17-43da-4089-8536-873507771f56 req-4992465b-453f-4330-94b6-4f361510e83e service nova] Acquiring lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:19:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0150fe17-43da-4089-8536-873507771f56 req-4992465b-453f-4330-94b6-4f361510e83e service nova] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:19:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0150fe17-43da-4089-8536-873507771f56 req-4992465b-453f-4330-94b6-4f361510e83e service nova] Lock "299bd8c5-7663-46b5-a37e-ff2716ceec83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:19:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-0150fe17-43da-4089-8536-873507771f56 req-4992465b-453f-4330-94b6-4f361510e83e service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] No waiting events found dispatching network-vif-plugged-9289b0af-721b-4957-b8be-ccd34c289acf {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:19:50 user nova-compute[70645]: WARNING nova.compute.manager [req-0150fe17-43da-4089-8536-873507771f56 req-4992465b-453f-4330-94b6-4f361510e83e service nova] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Received unexpected event network-vif-plugged-9289b0af-721b-4957-b8be-ccd34c289acf for instance with vm_state deleted and task_state None.
Jul 24 15:19:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:19:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:03 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690211988.9037673, 299bd8c5-7663-46b5-a37e-ff2716ceec83 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:20:03 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] VM Stopped (Lifecycle Event)
Jul 24 15:20:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-a38593b0-fbd7-40d5-9e98-dddc037354a2 None None] [instance: 299bd8c5-7663-46b5-a37e-ff2716ceec83] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:20:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "19fb3cac-76eb-4603-9810-911c200ad2e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:20:14 user nova-compute[70645]: INFO nova.compute.claims [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Claim successful on node user
Jul 24 15:20:14 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG nova.network.neutron [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:20:14 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:20:14 user nova-compute[70645]: DEBUG nova.compute.manager [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:20:14 user nova-compute[70645]: INFO nova.virt.block_device [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Booting with volume 6d5e887c-e759-400b-993e-9c667cd65f6c at /dev/vda
Jul 24 15:20:14 user nova-compute[70645]: DEBUG nova.policy [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a83e71e487ca401eb10e1d41d77b86fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92f320224c4b1e98b371f510a5e198', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG os_brick.utils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[32593034-d5f5-409f-8813-0893afc2b7f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fef650-7f42-42e5-98a4-9aaaf25da7ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f1bd21-0a96-4fcb-955a-d09ca408bcda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b045fc1-7156-4d49-a8f2-ab7e24baf12b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:20:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:20:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:20:15 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:20:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0f57a9-00cc-4e4a-b033-7ce7103017a2]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:20:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:20:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:20:15 user nova-compute[70645]: DEBUG os_brick.utils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:20:15 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Updating existing volume attachment record: 7eaeefc0-02dc-42c8-9911-7eb11c6d1a70 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:20:15 user nova-compute[70645]: DEBUG nova.network.neutron [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Successfully created port: 46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG nova.network.neutron [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Successfully updated port: 46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquired lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG nova.network.neutron [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-0256cc23-852a-47f6-bae4-33e774474a28 req-1ee90911-7dc3-494d-8836-a99e1eea7f42 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Received event network-changed-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-0256cc23-852a-47f6-bae4-33e774474a28 req-1ee90911-7dc3-494d-8836-a99e1eea7f42 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Refreshing instance network info cache due to event network-changed-46421e4f-a99a-4ff8-90fb-4eb56a9203d5. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0256cc23-852a-47f6-bae4-33e774474a28 req-1ee90911-7dc3-494d-8836-a99e1eea7f42 service nova] Acquiring lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG nova.network.neutron [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG nova.network.neutron [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Updating instance_info_cache with network_info: [{"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Releasing lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Instance network_info: |[{"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0256cc23-852a-47f6-bae4-33e774474a28 req-1ee90911-7dc3-494d-8836-a99e1eea7f42 service nova] Acquired lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:20:16 user nova-compute[70645]: DEBUG nova.network.neutron [req-0256cc23-852a-47f6-bae4-33e774474a28 req-1ee90911-7dc3-494d-8836-a99e1eea7f42 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Refreshing network info cache for port 46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:20:17 user nova-compute[70645]: DEBUG nova.network.neutron [req-0256cc23-852a-47f6-bae4-33e774474a28 req-1ee90911-7dc3-494d-8836-a99e1eea7f42 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Updated VIF entry in instance network info cache for port 46421e4f-a99a-4ff8-90fb-4eb56a9203d5. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:20:17 user nova-compute[70645]: DEBUG nova.network.neutron [req-0256cc23-852a-47f6-bae4-33e774474a28 req-1ee90911-7dc3-494d-8836-a99e1eea7f42 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Updating instance_info_cache with network_info: [{"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:20:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0256cc23-852a-47f6-bae4-33e774474a28 req-1ee90911-7dc3-494d-8836-a99e1eea7f42 service nova] Releasing lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:20:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.compute.manager [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:20:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Creating image(s)
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Ensure instance console log exists: /opt/stack/data/nova/instances/19fb3cac-76eb-4603-9810-911c200ad2e1/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Start _get_guest_xml network_info=[{"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7eaeefc0-02dc-42c8-9911-7eb11c6d1a70', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISXZUBot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '19fb3cac-76eb-4603-9810-911c200ad2e1', 'attached_at': '', 'detached_at': '', 'volume_id': '6d5e887c-e759-400b-993e-9c667cd65f6c', 'serial': '6d5e887c-e759-400b-993e-9c667cd65f6c'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:20:21 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:20:21 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISXZUBot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:20:21 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:20:21 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:20:21 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d5ea97-880d-4255-9368-1ac464a2684c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:20:21 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2e12e8-3883-4cdd-b816-52736eda8cd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c] added
Jul 24 15:20:21 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f1ba1d-f55c-42d6-9250-6251a4464714]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9de61f-0ec5-4579-b6d7-faf1075a9a03]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISXZUBot {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISXZUBot" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f468bc-e682-46c3-b870-a6e389aec979]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ISXZUBot'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[551ad89b-788e-451f-827b-9a8d4dbbe8b2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78f6475-eb22-4bf9-ae8f-65fd58c3cb75]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:20:21 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:20:21 user nova-compute[70645]:  {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:20:21 user nova-compute[70645]: WARNING os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 15:20:21 user nova-compute[70645]: 
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1005ff5a-bba3-4acf-b057-d9678c0b5825]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c, portal: 172.16.0.220,3260]
Jul 24 15:20:21 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c, portal: 172.16.0.220,3260] successful.
Jul 24 15:20:21 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e6ade8-281a-4530-88c4-2c7a110c27ca]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f87109e-770e-4b76-b8f0-f455dad221fc]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:20:21 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:20:21 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30f1e71-921f-4c89-9380-a81f56e6d91b]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:20:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISXZUBot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23838363364643430', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838363364643430', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-865840531',display_name='tempest-TestVolumeBootPattern-volume-backed-server-865840531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-865840531',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeVsqEf+Am9qW4zLqQYrSNITPpUc+StQfb3KdxIlRzdFLy2HDE1ldOuuVuWnuhbVB9/UQW/ZBDRrW7SMy7fTa2GsvMBAq3IIh1iHlSXrR4AdhfWoY6U5D7+6XfjGYG9sg==',key_name='tempest-keypair-880243971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-dz9y0iq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=19fb3cac-76eb-4603-9810-911c200ad2e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:08:88,bridge_name='br-int',has_traffic_filtering=True,id=46421e4f-a99a-4ff8-90fb-4eb56a9203d5,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46421e4f-a9') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG nova.objects.instance [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'pci_devices' on Instance uuid 19fb3cac-76eb-4603-9810-911c200ad2e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:20:22 user nova-compute[70645]:   <uuid>19fb3cac-76eb-4603-9810-911c200ad2e1</uuid>
Jul 24 15:20:22 user nova-compute[70645]:   <name>instance-0000002c</name>
Jul 24 15:20:22 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:20:22 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:20:22 user nova-compute[70645]:   <metadata>
Jul 24 15:20:22 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:20:22 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:20:22 user nova-compute[70645]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-865840531</nova:name>
Jul 24 15:20:22 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:20:21</nova:creationTime>
Jul 24 15:20:22 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:20:22 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:20:22 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:20:22 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:20:22 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:20:22 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:20:22 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:20:22 user nova-compute[70645]:       <nova:owner>
Jul 24 15:20:22 user nova-compute[70645]:         <nova:user uuid="a83e71e487ca401eb10e1d41d77b86fe">tempest-TestVolumeBootPattern-1424700934-project-member</nova:user>
Jul 24 15:20:22 user nova-compute[70645]:         <nova:project uuid="6f92f320224c4b1e98b371f510a5e198">tempest-TestVolumeBootPattern-1424700934</nova:project>
Jul 24 15:20:22 user nova-compute[70645]:       </nova:owner>
Jul 24 15:20:22 user nova-compute[70645]:       <nova:ports>
Jul 24 15:20:22 user nova-compute[70645]:         <nova:port uuid="46421e4f-a99a-4ff8-90fb-4eb56a9203d5">
Jul 24 15:20:22 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 15:20:22 user nova-compute[70645]:         </nova:port>
Jul 24 15:20:22 user nova-compute[70645]:       </nova:ports>
Jul 24 15:20:22 user nova-compute[70645]:     </nova:instance>
Jul 24 15:20:22 user nova-compute[70645]:   </metadata>
Jul 24 15:20:22 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:20:22 user nova-compute[70645]:     <system>
Jul 24 15:20:22 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:20:22 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:20:22 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:20:22 user nova-compute[70645]:       <entry name="serial">19fb3cac-76eb-4603-9810-911c200ad2e1</entry>
Jul 24 15:20:22 user nova-compute[70645]:       <entry name="uuid">19fb3cac-76eb-4603-9810-911c200ad2e1</entry>
Jul 24 15:20:22 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:20:22 user nova-compute[70645]:     </system>
Jul 24 15:20:22 user nova-compute[70645]:   </sysinfo>
Jul 24 15:20:22 user nova-compute[70645]:   <os>
Jul 24 15:20:22 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:20:22 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:20:22 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:20:22 user nova-compute[70645]:   </os>
Jul 24 15:20:22 user nova-compute[70645]:   <features>
Jul 24 15:20:22 user nova-compute[70645]:     <acpi/>
Jul 24 15:20:22 user nova-compute[70645]:     <apic/>
Jul 24 15:20:22 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:20:22 user nova-compute[70645]:   </features>
Jul 24 15:20:22 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:20:22 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:20:22 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:20:22 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:20:22 user nova-compute[70645]:   </clock>
Jul 24 15:20:22 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:20:22 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:20:22 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:20:22 user nova-compute[70645]:   </cpu>
Jul 24 15:20:22 user nova-compute[70645]:   <devices>
Jul 24 15:20:22 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:20:22 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:20:22 user nova-compute[70645]:       <source dev="/dev/sdb"/>
Jul 24 15:20:22 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:20:22 user nova-compute[70645]:       <serial>6d5e887c-e759-400b-993e-9c667cd65f6c</serial>
Jul 24 15:20:22 user nova-compute[70645]:     </disk>
Jul 24 15:20:22 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:20:22 user nova-compute[70645]:       <mac address="fa:16:3e:ef:08:88"/>
Jul 24 15:20:22 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:20:22 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:20:22 user nova-compute[70645]:       <target dev="tap46421e4f-a9"/>
Jul 24 15:20:22 user nova-compute[70645]:     </interface>
Jul 24 15:20:22 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:20:22 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/19fb3cac-76eb-4603-9810-911c200ad2e1/console.log" append="off"/>
Jul 24 15:20:22 user nova-compute[70645]:     </serial>
Jul 24 15:20:22 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:20:22 user nova-compute[70645]:     <video>
Jul 24 15:20:22 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:20:22 user nova-compute[70645]:     </video>
Jul 24 15:20:22 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:20:22 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:20:22 user nova-compute[70645]:     </rng>
Jul 24 15:20:22 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:20:22 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:20:22 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:20:22 user nova-compute[70645]:     </memballoon>
Jul 24 15:20:22 user nova-compute[70645]:   </devices>
Jul 24 15:20:22 user nova-compute[70645]: </domain>
Jul 24 15:20:22 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-865840531',display_name='tempest-TestVolumeBootPattern-volume-backed-server-865840531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-865840531',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeVsqEf+Am9qW4zLqQYrSNITPpUc+StQfb3KdxIlRzdFLy2HDE1ldOuuVuWnuhbVB9/UQW/ZBDRrW7SMy7fTa2GsvMBAq3IIh1iHlSXrR4AdhfWoY6U5D7+6XfjGYG9sg==',key_name='tempest-keypair-880243971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-dz9y0iq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=19fb3cac-76eb-4603-9810-911c200ad2e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:08:88,bridge_name='br-int',has_traffic_filtering=True,id=46421e4f-a99a-4ff8-90fb-4eb56a9203d5,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46421e4f-a9') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG os_vif [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:08:88,bridge_name='br-int',has_traffic_filtering=True,id=46421e4f-a99a-4ff8-90fb-4eb56a9203d5,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46421e4f-a9') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46421e4f-a9, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46421e4f-a9, col_values=(('external_ids', {'iface-id': '46421e4f-a99a-4ff8-90fb-4eb56a9203d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:08:88', 'vm-uuid': '19fb3cac-76eb-4603-9810-911c200ad2e1'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:22 user nova-compute[70645]: INFO os_vif [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:08:88,bridge_name='br-int',has_traffic_filtering=True,id=46421e4f-a99a-4ff8-90fb-4eb56a9203d5,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46421e4f-a9')
Jul 24 15:20:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:20:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No VIF found with MAC fa:16:3e:ef:08:88, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG nova.compute.manager [req-735233fb-4b5b-4c03-893e-21f74cb5857d req-7cdbea1a-d3f4-436f-a857-89b76d5bcde6 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Received event network-vif-plugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-735233fb-4b5b-4c03-893e-21f74cb5857d req-7cdbea1a-d3f4-436f-a857-89b76d5bcde6 service nova] Acquiring lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-735233fb-4b5b-4c03-893e-21f74cb5857d req-7cdbea1a-d3f4-436f-a857-89b76d5bcde6 service nova] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-735233fb-4b5b-4c03-893e-21f74cb5857d req-7cdbea1a-d3f4-436f-a857-89b76d5bcde6 service nova] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG nova.compute.manager [req-735233fb-4b5b-4c03-893e-21f74cb5857d req-7cdbea1a-d3f4-436f-a857-89b76d5bcde6 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] No waiting events found dispatching network-vif-plugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:20:24 user nova-compute[70645]: WARNING nova.compute.manager [req-735233fb-4b5b-4c03-893e-21f74cb5857d req-7cdbea1a-d3f4-436f-a857-89b76d5bcde6 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Received unexpected event network-vif-plugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 for instance with vm_state building and task_state spawning.
Jul 24 15:20:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "45b46753-8117-432b-b3ba-e241728b5957" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG nova.compute.manager [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:20:24 user nova-compute[70645]: INFO nova.compute.claims [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Claim successful on node user
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.network.neutron [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:20:25 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.policy [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07525ed635a7407495f38c9556e7ce59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7f4608ea8242fcbacfba6754da3628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.compute.manager [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:20:25 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Creating image(s)
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "/opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "/opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "/opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk 1073741824" returned: 0 in 0.056s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.network.neutron [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Successfully created port: 67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Cannot resize image /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.objects.instance [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'migration_context' on Instance uuid 45b46753-8117-432b-b3ba-e241728b5957 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Ensure instance console log exists: /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212026.2211213, 19fb3cac-76eb-4603-9810-911c200ad2e1 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:20:26 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] VM Resumed (Lifecycle Event)
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:20:26 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Instance spawned successfully.
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:26 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212026.2227323, 19fb3cac-76eb-4603-9810-911c200ad2e1 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:20:26 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] VM Started (Lifecycle Event)
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:20:26 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:20:26 user nova-compute[70645]: INFO nova.compute.manager [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Took 5.14 seconds to spawn the instance on the hypervisor.
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.compute.manager [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-229c39b4-e053-4436-befd-af090728300e req-f41cfd64-e6b3-4fe2-8db1-6de4fb375c1a service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Received event network-vif-plugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-229c39b4-e053-4436-befd-af090728300e req-f41cfd64-e6b3-4fe2-8db1-6de4fb375c1a service nova] Acquiring lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-229c39b4-e053-4436-befd-af090728300e req-f41cfd64-e6b3-4fe2-8db1-6de4fb375c1a service nova] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-229c39b4-e053-4436-befd-af090728300e req-f41cfd64-e6b3-4fe2-8db1-6de4fb375c1a service nova] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.compute.manager [req-229c39b4-e053-4436-befd-af090728300e req-f41cfd64-e6b3-4fe2-8db1-6de4fb375c1a service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] No waiting events found dispatching network-vif-plugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:20:26 user nova-compute[70645]: WARNING nova.compute.manager [req-229c39b4-e053-4436-befd-af090728300e req-f41cfd64-e6b3-4fe2-8db1-6de4fb375c1a service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Received unexpected event network-vif-plugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 for instance with vm_state building and task_state spawning.
Jul 24 15:20:26 user nova-compute[70645]: INFO nova.compute.manager [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Took 11.97 seconds to build instance.
Jul 24 15:20:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78399831-80d2-46b4-963e-d622b8f8944d tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.062s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.network.neutron [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Successfully updated port: 67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "refresh_cache-45b46753-8117-432b-b3ba-e241728b5957" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquired lock "refresh_cache-45b46753-8117-432b-b3ba-e241728b5957" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.network.neutron [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:20:26 user nova-compute[70645]: DEBUG nova.network.neutron [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.network.neutron [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Updating instance_info_cache with network_info: [{"id": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "address": "fa:16:3e:c7:a7:c1", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b7474e-56", "ovs_interfaceid": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Releasing lock "refresh_cache-45b46753-8117-432b-b3ba-e241728b5957" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.compute.manager [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Instance network_info: |[{"id": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "address": "fa:16:3e:c7:a7:c1", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b7474e-56", "ovs_interfaceid": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Start _get_guest_xml network_info=[{"id": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "address": "fa:16:3e:c7:a7:c1", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b7474e-56", "ovs_interfaceid": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:20:27 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:20:27 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1122565484',display_name='tempest-AttachVolumeNegativeTest-server-1122565484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1122565484',id=45,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByjR//jir28H+zO2ZEhm5fcsFi74neiUuUQT7wmcgQA6OGbmwOm+mmrHFRVz1E6sLeiY9BvWG2XfS3WqkFKuYlW3KgFeb+OnYUEaVb+/recddCRJhWDEYzIZ2DW0injQg==',key_name='tempest-keypair-144309234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-wdwvqmxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:20:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=45b46753-8117-432b-b3ba-e241728b5957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "address": "fa:16:3e:c7:a7:c1", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b7474e-56", "ovs_interfaceid": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "address": "fa:16:3e:c7:a7:c1", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b7474e-56", "ovs_interfaceid": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a7:c1,bridge_name='br-int',has_traffic_filtering=True,id=67b7474e-56a0-4d40-8b7f-1c18e2c6e549,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b7474e-56') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.objects.instance [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'pci_devices' on Instance uuid 45b46753-8117-432b-b3ba-e241728b5957 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:20:27 user nova-compute[70645]:   <uuid>45b46753-8117-432b-b3ba-e241728b5957</uuid>
Jul 24 15:20:27 user nova-compute[70645]:   <name>instance-0000002d</name>
Jul 24 15:20:27 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:20:27 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:20:27 user nova-compute[70645]:   <metadata>
Jul 24 15:20:27 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:20:27 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:20:27 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1122565484</nova:name>
Jul 24 15:20:27 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:20:27</nova:creationTime>
Jul 24 15:20:27 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:20:27 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:20:27 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:20:27 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:20:27 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:20:27 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:20:27 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:20:27 user nova-compute[70645]:       <nova:owner>
Jul 24 15:20:27 user nova-compute[70645]:         <nova:user uuid="07525ed635a7407495f38c9556e7ce59">tempest-AttachVolumeNegativeTest-508353659-project-member</nova:user>
Jul 24 15:20:27 user nova-compute[70645]:         <nova:project uuid="de7f4608ea8242fcbacfba6754da3628">tempest-AttachVolumeNegativeTest-508353659</nova:project>
Jul 24 15:20:27 user nova-compute[70645]:       </nova:owner>
Jul 24 15:20:27 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:20:27 user nova-compute[70645]:       <nova:ports>
Jul 24 15:20:27 user nova-compute[70645]:         <nova:port uuid="67b7474e-56a0-4d40-8b7f-1c18e2c6e549">
Jul 24 15:20:27 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 15:20:27 user nova-compute[70645]:         </nova:port>
Jul 24 15:20:27 user nova-compute[70645]:       </nova:ports>
Jul 24 15:20:27 user nova-compute[70645]:     </nova:instance>
Jul 24 15:20:27 user nova-compute[70645]:   </metadata>
Jul 24 15:20:27 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:20:27 user nova-compute[70645]:     <system>
Jul 24 15:20:27 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:20:27 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:20:27 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:20:27 user nova-compute[70645]:       <entry name="serial">45b46753-8117-432b-b3ba-e241728b5957</entry>
Jul 24 15:20:27 user nova-compute[70645]:       <entry name="uuid">45b46753-8117-432b-b3ba-e241728b5957</entry>
Jul 24 15:20:27 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:20:27 user nova-compute[70645]:     </system>
Jul 24 15:20:27 user nova-compute[70645]:   </sysinfo>
Jul 24 15:20:27 user nova-compute[70645]:   <os>
Jul 24 15:20:27 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:20:27 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:20:27 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:20:27 user nova-compute[70645]:   </os>
Jul 24 15:20:27 user nova-compute[70645]:   <features>
Jul 24 15:20:27 user nova-compute[70645]:     <acpi/>
Jul 24 15:20:27 user nova-compute[70645]:     <apic/>
Jul 24 15:20:27 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:20:27 user nova-compute[70645]:   </features>
Jul 24 15:20:27 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:20:27 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:20:27 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:20:27 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:20:27 user nova-compute[70645]:   </clock>
Jul 24 15:20:27 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:20:27 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:20:27 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:20:27 user nova-compute[70645]:   </cpu>
Jul 24 15:20:27 user nova-compute[70645]:   <devices>
Jul 24 15:20:27 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:20:27 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:20:27 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk"/>
Jul 24 15:20:27 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:20:27 user nova-compute[70645]:     </disk>
Jul 24 15:20:27 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:20:27 user nova-compute[70645]:       <mac address="fa:16:3e:c7:a7:c1"/>
Jul 24 15:20:27 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:20:27 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:20:27 user nova-compute[70645]:       <target dev="tap67b7474e-56"/>
Jul 24 15:20:27 user nova-compute[70645]:     </interface>
Jul 24 15:20:27 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:20:27 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/console.log" append="off"/>
Jul 24 15:20:27 user nova-compute[70645]:     </serial>
Jul 24 15:20:27 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:20:27 user nova-compute[70645]:     <video>
Jul 24 15:20:27 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:20:27 user nova-compute[70645]:     </video>
Jul 24 15:20:27 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:20:27 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:20:27 user nova-compute[70645]:     </rng>
Jul 24 15:20:27 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:20:27 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:20:27 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:20:27 user nova-compute[70645]:     </memballoon>
Jul 24 15:20:27 user nova-compute[70645]:   </devices>
Jul 24 15:20:27 user nova-compute[70645]: </domain>
Jul 24 15:20:27 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1122565484',display_name='tempest-AttachVolumeNegativeTest-server-1122565484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1122565484',id=45,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByjR//jir28H+zO2ZEhm5fcsFi74neiUuUQT7wmcgQA6OGbmwOm+mmrHFRVz1E6sLeiY9BvWG2XfS3WqkFKuYlW3KgFeb+OnYUEaVb+/recddCRJhWDEYzIZ2DW0injQg==',key_name='tempest-keypair-144309234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-wdwvqmxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:20:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=45b46753-8117-432b-b3ba-e241728b5957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "address": "fa:16:3e:c7:a7:c1", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b7474e-56", "ovs_interfaceid": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "address": "fa:16:3e:c7:a7:c1", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b7474e-56", "ovs_interfaceid": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a7:c1,bridge_name='br-int',has_traffic_filtering=True,id=67b7474e-56a0-4d40-8b7f-1c18e2c6e549,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b7474e-56') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG os_vif [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a7:c1,bridge_name='br-int',has_traffic_filtering=True,id=67b7474e-56a0-4d40-8b7f-1c18e2c6e549,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b7474e-56') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67b7474e-56, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67b7474e-56, col_values=(('external_ids', {'iface-id': '67b7474e-56a0-4d40-8b7f-1c18e2c6e549', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:a7:c1', 'vm-uuid': '45b46753-8117-432b-b3ba-e241728b5957'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:27 user nova-compute[70645]: INFO os_vif [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a7:c1,bridge_name='br-int',has_traffic_filtering=True,id=67b7474e-56a0-4d40-8b7f-1c18e2c6e549,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b7474e-56')
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:20:27 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No VIF found with MAC fa:16:3e:c7:a7:c1, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:20:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-b231f909-6c75-43b9-898b-cab22d3abe3e req-ed533b72-4cd3-4020-8f41-f082cb8d6335 service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Received event network-changed-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:20:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-b231f909-6c75-43b9-898b-cab22d3abe3e req-ed533b72-4cd3-4020-8f41-f082cb8d6335 service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Refreshing instance network info cache due to event network-changed-67b7474e-56a0-4d40-8b7f-1c18e2c6e549. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:20:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b231f909-6c75-43b9-898b-cab22d3abe3e req-ed533b72-4cd3-4020-8f41-f082cb8d6335 service nova] Acquiring lock "refresh_cache-45b46753-8117-432b-b3ba-e241728b5957" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:20:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b231f909-6c75-43b9-898b-cab22d3abe3e req-ed533b72-4cd3-4020-8f41-f082cb8d6335 service nova] Acquired lock "refresh_cache-45b46753-8117-432b-b3ba-e241728b5957" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:20:28 user nova-compute[70645]: DEBUG nova.network.neutron [req-b231f909-6c75-43b9-898b-cab22d3abe3e req-ed533b72-4cd3-4020-8f41-f082cb8d6335 service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Refreshing network info cache for port 67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:20:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:29 user nova-compute[70645]: DEBUG nova.network.neutron [req-b231f909-6c75-43b9-898b-cab22d3abe3e req-ed533b72-4cd3-4020-8f41-f082cb8d6335 service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Updated VIF entry in instance network info cache for port 67b7474e-56a0-4d40-8b7f-1c18e2c6e549. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:20:29 user nova-compute[70645]: DEBUG nova.network.neutron [req-b231f909-6c75-43b9-898b-cab22d3abe3e req-ed533b72-4cd3-4020-8f41-f082cb8d6335 service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Updating instance_info_cache with network_info: [{"id": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "address": "fa:16:3e:c7:a7:c1", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b7474e-56", "ovs_interfaceid": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:20:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b231f909-6c75-43b9-898b-cab22d3abe3e req-ed533b72-4cd3-4020-8f41-f082cb8d6335 service nova] Releasing lock "refresh_cache-45b46753-8117-432b-b3ba-e241728b5957" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:20:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Received event network-vif-plugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] Acquiring lock "45b46753-8117-432b-b3ba-e241728b5957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] Lock "45b46753-8117-432b-b3ba-e241728b5957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] Lock "45b46753-8117-432b-b3ba-e241728b5957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] No waiting events found dispatching network-vif-plugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:20:30 user nova-compute[70645]: WARNING nova.compute.manager [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Received unexpected event network-vif-plugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 for instance with vm_state building and task_state spawning.
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Received event network-vif-plugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] Acquiring lock "45b46753-8117-432b-b3ba-e241728b5957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] Lock "45b46753-8117-432b-b3ba-e241728b5957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] Lock "45b46753-8117-432b-b3ba-e241728b5957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] No waiting events found dispatching network-vif-plugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:20:30 user nova-compute[70645]: WARNING nova.compute.manager [req-080106a8-aa2a-4322-8b02-43a30bb8a4f2 req-2ea5ef30-bb3d-4d6e-859c-dde6841f10ac service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Received unexpected event network-vif-plugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 for instance with vm_state building and task_state spawning.
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212030.7197008, 45b46753-8117-432b-b3ba-e241728b5957 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:20:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 45b46753-8117-432b-b3ba-e241728b5957] VM Resumed (Lifecycle Event)
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:20:30 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Instance spawned successfully.
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:20:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 45b46753-8117-432b-b3ba-e241728b5957] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212030.7229931, 45b46753-8117-432b-b3ba-e241728b5957 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:20:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 45b46753-8117-432b-b3ba-e241728b5957] VM Started (Lifecycle Event)
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:20:30 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 45b46753-8117-432b-b3ba-e241728b5957] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:20:30 user nova-compute[70645]: INFO nova.compute.manager [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Took 5.57 seconds to spawn the instance on the hypervisor.
Jul 24 15:20:30 user nova-compute[70645]: DEBUG nova.compute.manager [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:20:30 user nova-compute[70645]: INFO nova.compute.manager [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Took 6.12 seconds to build instance.
Jul 24 15:20:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-037a6a2b-3a67-4612-a797-fbae1d745ef4 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.218s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:20:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:20:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:37 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:20:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:37 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:20:38 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:20:39 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:20:39 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:20:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8347MB free_disk=25.187732696533203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:20:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 47016839-ba35-418a-af61-d2b9ed1ffccc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:20:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance fa864eae-0ab7-4009-bd0c-b376075b1b2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:20:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 19fb3cac-76eb-4603-9810-911c200ad2e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:20:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 45b46753-8117-432b-b3ba-e241728b5957 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:20:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:20:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:20:40 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:20:40 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:20:40 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:20:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.808s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:41 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:20:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:20:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 15:20:41 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:20:41 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:20:41 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:20:41 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:20:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:20:42 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:20:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-98ec2815-2005-4abf-8ce0-47b098fe50db req-f8ff3a02-6d1b-4ba2-8476-0a3ed303a7c1 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received event network-changed-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-98ec2815-2005-4abf-8ce0-47b098fe50db req-f8ff3a02-6d1b-4ba2-8476-0a3ed303a7c1 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Refreshing instance network info cache due to event network-changed-5987a4b3-b4ae-472d-b509-1f527b9c64e7. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-98ec2815-2005-4abf-8ce0-47b098fe50db req-f8ff3a02-6d1b-4ba2-8476-0a3ed303a7c1 service nova] Acquiring lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-98ec2815-2005-4abf-8ce0-47b098fe50db req-f8ff3a02-6d1b-4ba2-8476-0a3ed303a7c1 service nova] Acquired lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-98ec2815-2005-4abf-8ce0-47b098fe50db req-f8ff3a02-6d1b-4ba2-8476-0a3ed303a7c1 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Refreshing network info cache for port 5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "47016839-ba35-418a-af61-d2b9ed1ffccc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:47 user nova-compute[70645]: INFO nova.compute.manager [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Terminating instance
Jul 24 15:20:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-0ab6b4d1-19fd-42e6-ba75-5146678012dc req-12d95dbf-a301-4dd7-821f-b930ab56511c service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received event network-vif-unplugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0ab6b4d1-19fd-42e6-ba75-5146678012dc req-12d95dbf-a301-4dd7-821f-b930ab56511c service nova] Acquiring lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0ab6b4d1-19fd-42e6-ba75-5146678012dc req-12d95dbf-a301-4dd7-821f-b930ab56511c service nova] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0ab6b4d1-19fd-42e6-ba75-5146678012dc req-12d95dbf-a301-4dd7-821f-b930ab56511c service nova] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-0ab6b4d1-19fd-42e6-ba75-5146678012dc req-12d95dbf-a301-4dd7-821f-b930ab56511c service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] No waiting events found dispatching network-vif-unplugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:20:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-0ab6b4d1-19fd-42e6-ba75-5146678012dc req-12d95dbf-a301-4dd7-821f-b930ab56511c service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received event network-vif-unplugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG nova.network.neutron [req-98ec2815-2005-4abf-8ce0-47b098fe50db req-f8ff3a02-6d1b-4ba2-8476-0a3ed303a7c1 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updated VIF entry in instance network info cache for port 5987a4b3-b4ae-472d-b509-1f527b9c64e7. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG nova.network.neutron [req-98ec2815-2005-4abf-8ce0-47b098fe50db req-f8ff3a02-6d1b-4ba2-8476-0a3ed303a7c1 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updating instance_info_cache with network_info: [{"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-98ec2815-2005-4abf-8ce0-47b098fe50db req-f8ff3a02-6d1b-4ba2-8476-0a3ed303a7c1 service nova] Releasing lock "refresh_cache-47016839-ba35-418a-af61-d2b9ed1ffccc" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Instance destroyed successfully.
Jul 24 15:20:48 user nova-compute[70645]: DEBUG nova.objects.instance [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lazy-loading 'resources' on Instance uuid 47016839-ba35-418a-af61-d2b9ed1ffccc {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-444649864',display_name='tempest-TestStampPattern-server-444649864',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-444649864',id=37,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpaiR09gawF0BiABPWc5BhN+ZqJhKaACzOhcrf2boJj0UiD0Yx//+fQ+eBUaDKWD1VfnztdaIfJWCRQbiO7xZZ9eT9akk4tzJdcm5XEY3bK9HSekgcRSxxbsyrKUsbDHw==',key_name='tempest-TestStampPattern-922639899',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:13:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d61e837ad1e437fb8b9ebee58a2e228',ramdisk_id='',reservation_id='r-u1340747',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-63827052',owner_user_name='tempest-TestStampPattern-63827052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:16:50Z,user_data=None,user_id='00e9c5d73ac941ed8b67471058c3db0a',uuid=47016839-ba35-418a-af61-d2b9ed1ffccc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converting VIF {"id": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "address": "fa:16:3e:7c:c5:ee", "network": {"id": "7a73cfff-2217-4a47-b859-45d33b0b9814", "bridge": "br-int", "label": "tempest-TestStampPattern-1397399378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d61e837ad1e437fb8b9ebee58a2e228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987a4b3-b4", "ovs_interfaceid": "5987a4b3-b4ae-472d-b509-1f527b9c64e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:c5:ee,bridge_name='br-int',has_traffic_filtering=True,id=5987a4b3-b4ae-472d-b509-1f527b9c64e7,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987a4b3-b4') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG os_vif [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:c5:ee,bridge_name='br-int',has_traffic_filtering=True,id=5987a4b3-b4ae-472d-b509-1f527b9c64e7,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987a4b3-b4') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5987a4b3-b4, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:48 user nova-compute[70645]: INFO os_vif [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:c5:ee,bridge_name='br-int',has_traffic_filtering=True,id=5987a4b3-b4ae-472d-b509-1f527b9c64e7,network=Network(7a73cfff-2217-4a47-b859-45d33b0b9814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987a4b3-b4')
Jul 24 15:20:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Deleting instance files /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc_del
Jul 24 15:20:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Deletion of /opt/stack/data/nova/instances/47016839-ba35-418a-af61-d2b9ed1ffccc_del complete
Jul 24 15:20:48 user nova-compute[70645]: INFO nova.compute.manager [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 24 15:20:48 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:20:48 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:20:49 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:20:49 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Took 0.50 seconds to deallocate network for instance.
Jul 24 15:20:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-fab1b209-2644-462d-8f23-70a8720692c3 req-5eaf8e4f-8d90-4267-8deb-d94284ba7da3 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received event network-vif-deleted-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:20:49 user nova-compute[70645]: INFO nova.compute.manager [req-fab1b209-2644-462d-8f23-70a8720692c3 req-5eaf8e4f-8d90-4267-8deb-d94284ba7da3 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Neutron deleted interface 5987a4b3-b4ae-472d-b509-1f527b9c64e7; detaching it from the instance and deleting it from the info cache
Jul 24 15:20:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-fab1b209-2644-462d-8f23-70a8720692c3 req-5eaf8e4f-8d90-4267-8deb-d94284ba7da3 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:20:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-fab1b209-2644-462d-8f23-70a8720692c3 req-5eaf8e4f-8d90-4267-8deb-d94284ba7da3 service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Detach interface failed, port_id=5987a4b3-b4ae-472d-b509-1f527b9c64e7, reason: Instance 47016839-ba35-418a-af61-d2b9ed1ffccc could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:20:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:49 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:20:49 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:20:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:49 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Deleted allocations for instance 47016839-ba35-418a-af61-d2b9ed1ffccc
Jul 24 15:20:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-12a38a52-d619-4606-926d-4a18fc93bb4e tempest-TestStampPattern-63827052 tempest-TestStampPattern-63827052-project-member] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.948s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-1dc1d265-9a3f-4aaa-aa95-51c652d045a9 req-ce3d6ec3-e762-4b51-8010-eda59c9b915c service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received event network-vif-plugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:20:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1dc1d265-9a3f-4aaa-aa95-51c652d045a9 req-ce3d6ec3-e762-4b51-8010-eda59c9b915c service nova] Acquiring lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:20:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1dc1d265-9a3f-4aaa-aa95-51c652d045a9 req-ce3d6ec3-e762-4b51-8010-eda59c9b915c service nova] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:20:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1dc1d265-9a3f-4aaa-aa95-51c652d045a9 req-ce3d6ec3-e762-4b51-8010-eda59c9b915c service nova] Lock "47016839-ba35-418a-af61-d2b9ed1ffccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:20:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-1dc1d265-9a3f-4aaa-aa95-51c652d045a9 req-ce3d6ec3-e762-4b51-8010-eda59c9b915c service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] No waiting events found dispatching network-vif-plugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:20:50 user nova-compute[70645]: WARNING nova.compute.manager [req-1dc1d265-9a3f-4aaa-aa95-51c652d045a9 req-ce3d6ec3-e762-4b51-8010-eda59c9b915c service nova] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Received unexpected event network-vif-plugged-5987a4b3-b4ae-472d-b509-1f527b9c64e7 for instance with vm_state deleted and task_state None.
Jul 24 15:20:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:20:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:20:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:03 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690212048.5441558, 47016839-ba35-418a-af61-d2b9ed1ffccc => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:21:03 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] VM Stopped (Lifecycle Event)
Jul 24 15:21:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-e4b3e6fb-0b3c-4751-b367-04693d60d2ae None None] [instance: 47016839-ba35-418a-af61-d2b9ed1ffccc] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:21:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:21:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:21:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:21:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:21:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:21:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:21:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:21:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:21:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:21:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:21:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG nova.objects.instance [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'flavor' on Instance uuid fa864eae-0ab7-4009-bd0c-b376075b1b2a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:21:28 user nova-compute[70645]: INFO nova.compute.manager [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Attaching volume 9a1394bf-bda6-494f-9d02-a34640b6a0da to /dev/vdb
Jul 24 15:21:28 user nova-compute[70645]: DEBUG os_brick.utils [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f91c1d2-6fde-43be-bd66-379ac6f3dfdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b61abf-7359-4a24-aab6-b4a62b849dcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7913331c-22df-45bf-97f3-aff899b27df4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee1fe29-8160-4c32-920b-6ee9dbf6462c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:21:28 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:21:28 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6902713d-09ca-48a2-a456-1ea1f6ebe703]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG os_brick.utils [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:21:28 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updating existing volume attachment record: 24d538f9-b9ea-4390-83a0-2936c8f82ea2 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:21:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OphUFwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:21:35 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:21:35 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:21:35 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dbc1a8-4205-4d86-ac8d-c4444d8e7ede]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:21:35 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7365c19-88f2-4dba-8f32-ea85b93e29a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da] added
Jul 24 15:21:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab19f290-5db2-42dc-8885-2d3443fe6ebc]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e8f98e-c40c-41e1-bf24-e6e531ab958e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OphUFwPd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OphUFwPd" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b292536-c0ee-4061-8942-6e325835dfcd]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OphUFwPd'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[90376098-36ba-4295-ab4f-d99f6a73d2ae]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[583e030f-e371-4510-91b8-25fe56b137d8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:21:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:21:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a64081c-09ad-4c42-b5fe-dbe2d462fcb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da, portal: 172.16.0.220,3260]
Jul 24 15:21:35 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da, portal: 172.16.0.220,3260] successful.
Jul 24 15:21:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea67155-ac26-4a51-9760-63f1938856bd]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf1228-1fa2-4a7f-893e-820c928c04eb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:21:35 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:21:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:21:35 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:21:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f625c0-6f40-4a1b-afcb-00e3c50b48e9]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:21:35 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:21:36 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:21:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OphUFwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:21:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:21:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23733376632346437', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:21:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733376632346437', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:21:36 user nova-compute[70645]: DEBUG nova.objects.instance [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'flavor' on Instance uuid fa864eae-0ab7-4009-bd0c-b376075b1b2a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:21:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:21:36 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:21:36 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:21:36 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:21:36 user nova-compute[70645]:   <serial>9a1394bf-bda6-494f-9d02-a34640b6a0da</serial>
Jul 24 15:21:36 user nova-compute[70645]: </disk>
Jul 24 15:21:36 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:21:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:21:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:21:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] No VIF found with MAC fa:16:3e:2f:2d:15, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:21:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-78651d8d-79d5-4da5-8036-aec48417e9bb tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.318s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:21:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:21:38 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:21:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-915edecc-9551-4415-99b5-9db18928cd3c req-72eb3def-fcc4-4784-b779-fdf8f45a9917 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-changed-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG nova.compute.manager [req-915edecc-9551-4415-99b5-9db18928cd3c req-72eb3def-fcc4-4784-b779-fdf8f45a9917 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Refreshing instance network info cache due to event network-changed-c49723c2-20d7-4b28-b6df-d23b9af56066. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-915edecc-9551-4415-99b5-9db18928cd3c req-72eb3def-fcc4-4784-b779-fdf8f45a9917 service nova] Acquiring lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-915edecc-9551-4415-99b5-9db18928cd3c req-72eb3def-fcc4-4784-b779-fdf8f45a9917 service nova] Acquired lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG nova.network.neutron [req-915edecc-9551-4415-99b5-9db18928cd3c req-72eb3def-fcc4-4784-b779-fdf8f45a9917 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Refreshing network info cache for port c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG nova.network.neutron [req-915edecc-9551-4415-99b5-9db18928cd3c req-72eb3def-fcc4-4784-b779-fdf8f45a9917 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updated VIF entry in instance network info cache for port c49723c2-20d7-4b28-b6df-d23b9af56066. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG nova.network.neutron [req-915edecc-9551-4415-99b5-9db18928cd3c req-72eb3def-fcc4-4784-b779-fdf8f45a9917 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updating instance_info_cache with network_info: [{"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:21:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-915edecc-9551-4415-99b5-9db18928cd3c req-72eb3def-fcc4-4784-b779-fdf8f45a9917 service nova] Releasing lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:21:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:21:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:21:40 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:21:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:21:41 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:21:41 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8507MB free_disk=25.283851623535156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance fa864eae-0ab7-4009-bd0c-b376075b1b2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 19fb3cac-76eb-4603-9810-911c200ad2e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 45b46753-8117-432b-b3ba-e241728b5957 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-7afa33a6-a6de-4cc4-ae09-6ebee57ed660 req-5b0bfc5d-ae20-4c1f-b8dd-a7ae03c42e9c service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-changed-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.compute.manager [req-7afa33a6-a6de-4cc4-ae09-6ebee57ed660 req-5b0bfc5d-ae20-4c1f-b8dd-a7ae03c42e9c service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Refreshing instance network info cache due to event network-changed-c49723c2-20d7-4b28-b6df-d23b9af56066. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7afa33a6-a6de-4cc4-ae09-6ebee57ed660 req-5b0bfc5d-ae20-4c1f-b8dd-a7ae03c42e9c service nova] Acquiring lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7afa33a6-a6de-4cc4-ae09-6ebee57ed660 req-5b0bfc5d-ae20-4c1f-b8dd-a7ae03c42e9c service nova] Acquired lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:21:41 user nova-compute[70645]: DEBUG nova.network.neutron [req-7afa33a6-a6de-4cc4-ae09-6ebee57ed660 req-5b0bfc5d-ae20-4c1f-b8dd-a7ae03c42e9c service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Refreshing network info cache for port c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:21:42 user nova-compute[70645]: INFO nova.compute.manager [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Rebooting instance
Jul 24 15:21:42 user nova-compute[70645]: DEBUG nova.network.neutron [req-7afa33a6-a6de-4cc4-ae09-6ebee57ed660 req-5b0bfc5d-ae20-4c1f-b8dd-a7ae03c42e9c service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updated VIF entry in instance network info cache for port c49723c2-20d7-4b28-b6df-d23b9af56066. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG nova.network.neutron [req-7afa33a6-a6de-4cc4-ae09-6ebee57ed660 req-5b0bfc5d-ae20-4c1f-b8dd-a7ae03c42e9c service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updating instance_info_cache with network_info: [{"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-7afa33a6-a6de-4cc4-ae09-6ebee57ed660 req-5b0bfc5d-ae20-4c1f-b8dd-a7ae03c42e9c service nova] Releasing lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquired lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG nova.network.neutron [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updating instance_info_cache with network_info: [{"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Releasing lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid fa864eae-0ab7-4009-bd0c-b376075b1b2a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:21:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:21:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updating instance_info_cache with network_info: [{"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:21:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:21:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:21:43 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:21:43 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:21:43 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:21:43 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:21:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:21:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:21:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-f6a51e2e-0a3c-4878-88c9-2adb7ffa5d0c req-ef119315-01fd-4827-ab95-4527c3a3c257 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-vif-unplugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:21:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f6a51e2e-0a3c-4878-88c9-2adb7ffa5d0c req-ef119315-01fd-4827-ab95-4527c3a3c257 service nova] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:21:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f6a51e2e-0a3c-4878-88c9-2adb7ffa5d0c req-ef119315-01fd-4827-ab95-4527c3a3c257 service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:21:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f6a51e2e-0a3c-4878-88c9-2adb7ffa5d0c req-ef119315-01fd-4827-ab95-4527c3a3c257 service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:21:45 user nova-compute[70645]: DEBUG nova.compute.manager [req-f6a51e2e-0a3c-4878-88c9-2adb7ffa5d0c req-ef119315-01fd-4827-ab95-4527c3a3c257 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] No waiting events found dispatching network-vif-unplugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:21:45 user nova-compute[70645]: WARNING nova.compute.manager [req-f6a51e2e-0a3c-4878-88c9-2adb7ffa5d0c req-ef119315-01fd-4827-ab95-4527c3a3c257 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received unexpected event network-vif-unplugged-c49723c2-20d7-4b28-b6df-d23b9af56066 for instance with vm_state active and task_state reboot_started.
Jul 24 15:21:45 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Instance shutdown successfully.
Jul 24 15:21:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] No waiting events found dispatching network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:21:47 user nova-compute[70645]: WARNING nova.compute.manager [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received unexpected event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 for instance with vm_state active and task_state reboot_started.
Jul 24 15:21:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:21:47 user nova-compute[70645]: DEBUG nova.compute.manager [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] No waiting events found dispatching network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:21:47 user nova-compute[70645]: WARNING nova.compute.manager [req-233e6751-839e-4a9a-b9ad-61bc7db1ae28 req-c15223e0-7360-4a4b-b164-8783a0eb740e service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received unexpected event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 for instance with vm_state active and task_state reboot_started.
Jul 24 15:21:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Removed pending event for fa864eae-0ab7-4009-bd0c-b376075b1b2a due to event {{(pid=70645) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212109.183662, fa864eae-0ab7-4009-bd0c-b376075b1b2a => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:21:49 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] VM Resumed (Lifecycle Event)
Jul 24 15:21:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Instance running successfully.
Jul 24 15:21:49 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Instance soft rebooted successfully.
Jul 24 15:21:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:21:49 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 24 15:21:49 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212109.1873841, fa864eae-0ab7-4009-bd0c-b376075b1b2a => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:21:49 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] VM Started (Lifecycle Event)
Jul 24 15:21:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-0d1c3b70-7f62-4fa8-add1-b43724e3cb30 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.175s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-608632cd-00bd-4bd2-80a1-fdbb73ff08c0 req-d6d12e2d-ff46-4899-98af-797a0e5e28fe service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-608632cd-00bd-4bd2-80a1-fdbb73ff08c0 req-d6d12e2d-ff46-4899-98af-797a0e5e28fe service nova] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-608632cd-00bd-4bd2-80a1-fdbb73ff08c0 req-d6d12e2d-ff46-4899-98af-797a0e5e28fe service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-608632cd-00bd-4bd2-80a1-fdbb73ff08c0 req-d6d12e2d-ff46-4899-98af-797a0e5e28fe service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:21:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-608632cd-00bd-4bd2-80a1-fdbb73ff08c0 req-d6d12e2d-ff46-4899-98af-797a0e5e28fe service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] No waiting events found dispatching network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:21:49 user nova-compute[70645]: WARNING nova.compute.manager [req-608632cd-00bd-4bd2-80a1-fdbb73ff08c0 req-d6d12e2d-ff46-4899-98af-797a0e5e28fe service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received unexpected event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 for instance with vm_state active and task_state None.
Jul 24 15:21:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:21:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-3f521d79-d50d-4c39-b453-100d90768a9f req-528eb3d9-025a-42e3-8793-59670b2873de service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Received event network-changed-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:22:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-3f521d79-d50d-4c39-b453-100d90768a9f req-528eb3d9-025a-42e3-8793-59670b2873de service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Refreshing instance network info cache due to event network-changed-46421e4f-a99a-4ff8-90fb-4eb56a9203d5. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:22:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3f521d79-d50d-4c39-b453-100d90768a9f req-528eb3d9-025a-42e3-8793-59670b2873de service nova] Acquiring lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:22:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3f521d79-d50d-4c39-b453-100d90768a9f req-528eb3d9-025a-42e3-8793-59670b2873de service nova] Acquired lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:22:05 user nova-compute[70645]: DEBUG nova.network.neutron [req-3f521d79-d50d-4c39-b453-100d90768a9f req-528eb3d9-025a-42e3-8793-59670b2873de service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Refreshing network info cache for port 46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:22:06 user nova-compute[70645]: DEBUG nova.network.neutron [req-3f521d79-d50d-4c39-b453-100d90768a9f req-528eb3d9-025a-42e3-8793-59670b2873de service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Updated VIF entry in instance network info cache for port 46421e4f-a99a-4ff8-90fb-4eb56a9203d5. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:22:06 user nova-compute[70645]: DEBUG nova.network.neutron [req-3f521d79-d50d-4c39-b453-100d90768a9f req-528eb3d9-025a-42e3-8793-59670b2873de service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Updating instance_info_cache with network_info: [{"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:22:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3f521d79-d50d-4c39-b453-100d90768a9f req-528eb3d9-025a-42e3-8793-59670b2873de service nova] Releasing lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:22:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:22:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:22:12 user nova-compute[70645]: DEBUG nova.compute.manager [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:22:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:22:12 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:22:12 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:22:12 user nova-compute[70645]: INFO nova.compute.claims [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Claim successful on node user
Jul 24 15:22:13 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:22:13 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:22:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:22:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:22:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:13 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:22:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:22:13 user nova-compute[70645]: DEBUG nova.network.neutron [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:22:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:22:13 user nova-compute[70645]: DEBUG nova.policy [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a83e71e487ca401eb10e1d41d77b86fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92f320224c4b1e98b371f510a5e198', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:22:13 user nova-compute[70645]: INFO nova.virt.block_device [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Booting with volume snapshot adb531c9-f566-422c-98c7-770344f42fff at /dev/vda
Jul 24 15:22:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:14 user nova-compute[70645]: DEBUG nova.network.neutron [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Successfully created port: 7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG nova.network.neutron [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Successfully updated port: 7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "refresh_cache-1ebc6554-5bd9-4fa2-8f10-1be458e549f0" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquired lock "refresh_cache-1ebc6554-5bd9-4fa2-8f10-1be458e549f0" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG nova.network.neutron [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG nova.compute.manager [req-15ea9d9a-4805-42f1-af99-9e32ee40dd4b req-7b3a7d08-c383-4234-9d0a-6f9038aff54b service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Received event network-changed-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG nova.compute.manager [req-15ea9d9a-4805-42f1-af99-9e32ee40dd4b req-7b3a7d08-c383-4234-9d0a-6f9038aff54b service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Refreshing instance network info cache due to event network-changed-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-15ea9d9a-4805-42f1-af99-9e32ee40dd4b req-7b3a7d08-c383-4234-9d0a-6f9038aff54b service nova] Acquiring lock "refresh_cache-1ebc6554-5bd9-4fa2-8f10-1be458e549f0" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG nova.network.neutron [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG nova.network.neutron [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Updating instance_info_cache with network_info: [{"id": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "address": "fa:16:3e:4a:52:2e", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e03b403-4c", "ovs_interfaceid": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Releasing lock "refresh_cache-1ebc6554-5bd9-4fa2-8f10-1be458e549f0" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG nova.compute.manager [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Instance network_info: |[{"id": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "address": "fa:16:3e:4a:52:2e", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e03b403-4c", "ovs_interfaceid": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-15ea9d9a-4805-42f1-af99-9e32ee40dd4b req-7b3a7d08-c383-4234-9d0a-6f9038aff54b service nova] Acquired lock "refresh_cache-1ebc6554-5bd9-4fa2-8f10-1be458e549f0" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:22:15 user nova-compute[70645]: DEBUG nova.network.neutron [req-15ea9d9a-4805-42f1-af99-9e32ee40dd4b req-7b3a7d08-c383-4234-9d0a-6f9038aff54b service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Refreshing network info cache for port 7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:22:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-881db992-34e5-4023-b306-81a4a09f20f3 req-381dd467-6fa0-4c94-bd4d-916f5164dfcf service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Received event network-changed-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:22:16 user nova-compute[70645]: DEBUG nova.compute.manager [req-881db992-34e5-4023-b306-81a4a09f20f3 req-381dd467-6fa0-4c94-bd4d-916f5164dfcf service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Refreshing instance network info cache due to event network-changed-67b7474e-56a0-4d40-8b7f-1c18e2c6e549. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:22:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-881db992-34e5-4023-b306-81a4a09f20f3 req-381dd467-6fa0-4c94-bd4d-916f5164dfcf service nova] Acquiring lock "refresh_cache-45b46753-8117-432b-b3ba-e241728b5957" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:22:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-881db992-34e5-4023-b306-81a4a09f20f3 req-381dd467-6fa0-4c94-bd4d-916f5164dfcf service nova] Acquired lock "refresh_cache-45b46753-8117-432b-b3ba-e241728b5957" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:22:16 user nova-compute[70645]: DEBUG nova.network.neutron [req-881db992-34e5-4023-b306-81a4a09f20f3 req-381dd467-6fa0-4c94-bd4d-916f5164dfcf service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Refreshing network info cache for port 67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:22:16 user nova-compute[70645]: DEBUG nova.network.neutron [req-15ea9d9a-4805-42f1-af99-9e32ee40dd4b req-7b3a7d08-c383-4234-9d0a-6f9038aff54b service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Updated VIF entry in instance network info cache for port 7e03b403-4c19-4d5a-b4fd-9847cea2ba4e. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:22:16 user nova-compute[70645]: DEBUG nova.network.neutron [req-15ea9d9a-4805-42f1-af99-9e32ee40dd4b req-7b3a7d08-c383-4234-9d0a-6f9038aff54b service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Updating instance_info_cache with network_info: [{"id": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "address": "fa:16:3e:4a:52:2e", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e03b403-4c", "ovs_interfaceid": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:22:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-15ea9d9a-4805-42f1-af99-9e32ee40dd4b req-7b3a7d08-c383-4234-9d0a-6f9038aff54b service nova] Releasing lock "refresh_cache-1ebc6554-5bd9-4fa2-8f10-1be458e549f0" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:22:16 user nova-compute[70645]: DEBUG nova.network.neutron [req-881db992-34e5-4023-b306-81a4a09f20f3 req-381dd467-6fa0-4c94-bd4d-916f5164dfcf service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Updated VIF entry in instance network info cache for port 67b7474e-56a0-4d40-8b7f-1c18e2c6e549. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:22:16 user nova-compute[70645]: DEBUG nova.network.neutron [req-881db992-34e5-4023-b306-81a4a09f20f3 req-381dd467-6fa0-4c94-bd4d-916f5164dfcf service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Updating instance_info_cache with network_info: [{"id": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "address": "fa:16:3e:c7:a7:c1", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b7474e-56", "ovs_interfaceid": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:22:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-881db992-34e5-4023-b306-81a4a09f20f3 req-381dd467-6fa0-4c94-bd4d-916f5164dfcf service nova] Releasing lock "refresh_cache-45b46753-8117-432b-b3ba-e241728b5957" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:22:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "45b46753-8117-432b-b3ba-e241728b5957" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:22:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:22:18 user nova-compute[70645]: DEBUG nova.objects.instance [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'flavor' on Instance uuid 45b46753-8117-432b-b3ba-e241728b5957 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:22:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "45b46753-8117-432b-b3ba-e241728b5957" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:22:19 user nova-compute[70645]: INFO nova.compute.manager [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Attaching volume 5a9e1577-19ed-4924-b612-2e62b084dcb8 to /dev/vdb
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.utils [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ebc0c-a4de-49b7-9d4f-5abd59cc2227]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.utils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad074b0-0e2a-47c0-b5f6-1b85770334ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce3ed1a-a6db-49f2-889f-67f1d6ec82c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21959ea-e13f-457d-8c1d-46c231106cc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddc300d-69de-4937-b905-14a4e538a2f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1339e853-223e-45b8-b443-ae452973cb97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6352a33-5f91-4780-a6ae-140bd26e5ed3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:22:19 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[617e76cb-e4d5-45e5-b9dc-35d8d1e33a40]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.utils [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Updating existing volume attachment record: 42718232-309d-467a-a350-df883c0ff28b {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0babbccc-dccf-497d-bba7-82482c40530b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:22:19 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:22:19 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b92dbd-5818-43ac-9887-42923fe132c2]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG os_brick.utils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:22:19 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Updating existing volume attachment record: 994565cc-a663-47f6-bda2-39384005514b {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:22:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVOhAkIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:22:29 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:22:29 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:22:29 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[af086c11-568e-4dea-916a-a4831b4b17c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:22:29 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceaf21a-d1d8-410f-b9dd-566fd0ad6fbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8] added
Jul 24 15:22:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ca2599-96ce-4811-be1c-2ea7c93c9c8c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80db13b-1939-453b-8438-c3dcba557a8d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DVOhAkIP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DVOhAkIP" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bbadf1-8753-4663-b14f-b601759eb3f2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DVOhAkIP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cb50e1-9ab6-46db-8f77-21a87b320c99]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dd1a52-bb2e-4583-8847-91164856741b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:22:29 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:22:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:22:29 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:22:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93ec7bf-9a97-4c4f-94af-e664ba2afa64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8, portal: 172.16.0.220,3260]
Jul 24 15:22:29 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8, portal: 172.16.0.220,3260] successful.
Jul 24 15:22:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f38639-3708-45ca-9209-231f82b143a9]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e12a74-cdd8-426e-a794-501d1a88c384]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:22:29 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:22:29 user nova-compute[70645]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 (non-flash)
Jul 24 15:22:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:22:29 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:22:29 user nova-compute[70645]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 (non-flash)
Jul 24 15:22:29 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[484305a5-7e0f-4619-9ee0-e21472d355ec]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:29 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:22:30 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:22:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVOhAkIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:22:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:22:30 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26464666339653039', 'path': '/dev/sdd'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:22:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464666339653039', 'path': '/dev/sdd'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:22:30 user nova-compute[70645]: DEBUG nova.objects.instance [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'flavor' on Instance uuid 45b46753-8117-432b-b3ba-e241728b5957 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:22:30 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:22:30 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:22:30 user nova-compute[70645]:   <source dev="/dev/sdd"/>
Jul 24 15:22:30 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:22:30 user nova-compute[70645]:   <serial>5a9e1577-19ed-4924-b612-2e62b084dcb8</serial>
Jul 24 15:22:30 user nova-compute[70645]: </disk>
Jul 24 15:22:30 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:22:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:22:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:22:31 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No VIF found with MAC fa:16:3e:c7:a7:c1, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:22:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-8d6e833c-6b31-4274-9ad8-8e9deb0f47fc tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.279s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "45b46753-8117-432b-b3ba-e241728b5957" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:22:32 user nova-compute[70645]: INFO nova.compute.manager [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Detaching volume 5a9e1577-19ed-4924-b612-2e62b084dcb8
Jul 24 15:22:32 user nova-compute[70645]: INFO nova.virt.block_device [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Attempting to driver detach volume 5a9e1577-19ed-4924-b612-2e62b084dcb8 from mountpoint /dev/vdb
Jul 24 15:22:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Attempting to detach device vdb from instance 45b46753-8117-432b-b3ba-e241728b5957 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:22:32 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:22:32 user nova-compute[70645]:   <source dev="/dev/sdd"/>
Jul 24 15:22:32 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:22:32 user nova-compute[70645]:   <serial>5a9e1577-19ed-4924-b612-2e62b084dcb8</serial>
Jul 24 15:22:32 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:22:32 user nova-compute[70645]: </disk>
Jul 24 15:22:32 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:22:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully detached device vdb from instance 45b46753-8117-432b-b3ba-e241728b5957 from the persistent domain config.
Jul 24 15:22:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45b46753-8117-432b-b3ba-e241728b5957 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:22:32 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:22:32 user nova-compute[70645]:   <source dev="/dev/sdd"/>
Jul 24 15:22:32 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:22:32 user nova-compute[70645]:   <serial>5a9e1577-19ed-4924-b612-2e62b084dcb8</serial>
Jul 24 15:22:32 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:22:32 user nova-compute[70645]: </disk>
Jul 24 15:22:32 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690212152.82076, 45b46753-8117-432b-b3ba-e241728b5957 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45b46753-8117-432b-b3ba-e241728b5957 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:22:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully detached device vdb from instance 45b46753-8117-432b-b3ba-e241728b5957 from the live domain config.
Jul 24 15:22:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVOhAkIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:22:32 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[24722947-99f7-4cc9-9331-bf622e20db78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5c9cf1-4f05-4bd2-baec-222d70b5fddd]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:22:32 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:22:32 user nova-compute[70645]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 (non-flash)
Jul 24 15:22:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:22:32 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:22:32 user nova-compute[70645]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 (non-flash)
Jul 24 15:22:32 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba8467bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8'): ({'sdd'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Removing single pathed devices sdd {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa01375-85e3-4247-8ecb-169b141058a0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67a0e17-7fa1-4658-91ea-2d63bb714d01]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Flushing IO for device /dev/sdd {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[45897f9b-a15f-4477-b97f-148a46e9b1f6]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9911e5-0fc0-41d0-af71-3a0dcb106021]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:22:32 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9c7c00-9c22-416c-ba86-466109d3b73d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ee671c-970f-4338-804b-cd7c8991dfc7]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8, portal: 172.16.0.220,3260]
Jul 24 15:22:33 user nova-compute[70645]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8, portal: 172.16.0.220,3260] successful.
Jul 24 15:22:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9e1577-19ed-4924-b612-2e62b084dcb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4900e85-d7e2-4c51-8fd2-2df5b1a0234b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] <== disconnect_volume: return (273ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.compute.manager [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:22:33 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Creating image(s)
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Ensure instance console log exists: /opt/stack/data/nova/instances/1ebc6554-5bd9-4fa2-8f10-1be458e549f0/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Start _get_guest_xml network_info=[{"id": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "address": "fa:16:3e:4a:52:2e", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e03b403-4c", "ovs_interfaceid": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-24T15:22:07Z,direct_url=<?>,disk_format='qcow2',id=91a7b7ba-1070-4181-a3ba-28230b91bf59,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-333865152',owner='6f92f320224c4b1e98b371f510a5e198',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-24T15:22:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '994565cc-a663-47f6-bda2-39384005514b', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMZclnLo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ebc6554-5bd9-4fa2-8f10-1be458e549f0', 'attached_at': '', 'detached_at': '', 'volume_id': '522a34ad-ddc7-46af-a1d9-303cc6291529', 'serial': '522a34ad-ddc7-46af-a1d9-303cc6291529'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:22:33 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:22:33 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-24T15:22:07Z,direct_url=<?>,disk_format='qcow2',id=91a7b7ba-1070-4181-a3ba-28230b91bf59,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-333865152',owner='6f92f320224c4b1e98b371f510a5e198',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-24T15:22:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMZclnLo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:22:33 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:22:33 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:22:33 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a63154-36fe-409e-aadb-1d6767e7e226]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:22:33 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b4f143-6222-439d-bd82-7df628f38c6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529] added
Jul 24 15:22:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1a1460-b285-4cb0-844a-55b25ac57a86]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9edb40-fc47-4ebd-aeec-b5e60198b8c2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMZclnLo {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMZclnLo" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5392bb8-8bcf-446a-9ddf-89d0f235f564]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yMZclnLo'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f4c67a-0867-46dc-80ce-17b0e4bfe6d1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebdae5a-b143-4ae6-aec4-160f7ed0019a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:22:33 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:22:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:22:33 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:22:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b540d3f2-7f82-4436-92df-3f7ba71387d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529, portal: 172.16.0.220,3260]
Jul 24 15:22:33 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529, portal: 172.16.0.220,3260] successful.
Jul 24 15:22:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b736be-b397-455d-aa0f-188b345dec56]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc02cdf4-9f71-4cbe-b06e-81f67f0c300c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:22:33 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:22:33 user nova-compute[70645]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 (non-flash)
Jul 24 15:22:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:22:33 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:22:33 user nova-compute[70645]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 (non-flash)
Jul 24 15:22:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[da557713-fb3e-4a88-b02e-d53ff6e420ae]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:22:33 user nova-compute[70645]: DEBUG nova.objects.instance [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'flavor' on Instance uuid 45b46753-8117-432b-b3ba-e241728b5957 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-94c65614-bc3c-4bda-a26f-90ff4abaa3e5 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.719s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMZclnLo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23761316165386464', 'path': '/dev/sdd'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761316165386464', 'path': '/dev/sdd'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1666749559',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1666749559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1666749559',id=46,image_ref='91a7b7ba-1070-4181-a3ba-28230b91bf59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4wAuVx/0nRWcLuXDaB5PTg0f+7+0MzMXILlfxGNBfFeN9I4XHz13lAl1krhipvnrSr0FJvc6czZnL+ELSoFms961sLPZxTZYu7QMKYpGYvbJKT6WFMJPlIwHqwtKxhmw==',key_name='tempest-keypair-1983985393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-b46c4hqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1424700934',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=1ebc6554-5bd9-4fa2-8f10-1be458e549f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "address": "fa:16:3e:4a:52:2e", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e03b403-4c", "ovs_interfaceid": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "address": "fa:16:3e:4a:52:2e", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e03b403-4c", "ovs_interfaceid": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=7e03b403-4c19-4d5a-b4fd-9847cea2ba4e,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e03b403-4c') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG nova.objects.instance [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ebc6554-5bd9-4fa2-8f10-1be458e549f0 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:22:34 user nova-compute[70645]:   <uuid>1ebc6554-5bd9-4fa2-8f10-1be458e549f0</uuid>
Jul 24 15:22:34 user nova-compute[70645]:   <name>instance-0000002e</name>
Jul 24 15:22:34 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:22:34 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:22:34 user nova-compute[70645]:   <metadata>
Jul 24 15:22:34 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:22:34 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:22:34 user nova-compute[70645]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1666749559</nova:name>
Jul 24 15:22:34 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:22:33</nova:creationTime>
Jul 24 15:22:34 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:22:34 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:22:34 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:22:34 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:22:34 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:22:34 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:22:34 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:22:34 user nova-compute[70645]:       <nova:owner>
Jul 24 15:22:34 user nova-compute[70645]:         <nova:user uuid="a83e71e487ca401eb10e1d41d77b86fe">tempest-TestVolumeBootPattern-1424700934-project-member</nova:user>
Jul 24 15:22:34 user nova-compute[70645]:         <nova:project uuid="6f92f320224c4b1e98b371f510a5e198">tempest-TestVolumeBootPattern-1424700934</nova:project>
Jul 24 15:22:34 user nova-compute[70645]:       </nova:owner>
Jul 24 15:22:34 user nova-compute[70645]:       <nova:root type="image" uuid="91a7b7ba-1070-4181-a3ba-28230b91bf59"/>
Jul 24 15:22:34 user nova-compute[70645]:       <nova:ports>
Jul 24 15:22:34 user nova-compute[70645]:         <nova:port uuid="7e03b403-4c19-4d5a-b4fd-9847cea2ba4e">
Jul 24 15:22:34 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 15:22:34 user nova-compute[70645]:         </nova:port>
Jul 24 15:22:34 user nova-compute[70645]:       </nova:ports>
Jul 24 15:22:34 user nova-compute[70645]:     </nova:instance>
Jul 24 15:22:34 user nova-compute[70645]:   </metadata>
Jul 24 15:22:34 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:22:34 user nova-compute[70645]:     <system>
Jul 24 15:22:34 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:22:34 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:22:34 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:22:34 user nova-compute[70645]:       <entry name="serial">1ebc6554-5bd9-4fa2-8f10-1be458e549f0</entry>
Jul 24 15:22:34 user nova-compute[70645]:       <entry name="uuid">1ebc6554-5bd9-4fa2-8f10-1be458e549f0</entry>
Jul 24 15:22:34 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:22:34 user nova-compute[70645]:     </system>
Jul 24 15:22:34 user nova-compute[70645]:   </sysinfo>
Jul 24 15:22:34 user nova-compute[70645]:   <os>
Jul 24 15:22:34 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:22:34 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:22:34 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:22:34 user nova-compute[70645]:   </os>
Jul 24 15:22:34 user nova-compute[70645]:   <features>
Jul 24 15:22:34 user nova-compute[70645]:     <acpi/>
Jul 24 15:22:34 user nova-compute[70645]:     <apic/>
Jul 24 15:22:34 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:22:34 user nova-compute[70645]:   </features>
Jul 24 15:22:34 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:22:34 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:22:34 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:22:34 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:22:34 user nova-compute[70645]:   </clock>
Jul 24 15:22:34 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:22:34 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:22:34 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:22:34 user nova-compute[70645]:   </cpu>
Jul 24 15:22:34 user nova-compute[70645]:   <devices>
Jul 24 15:22:34 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:22:34 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:22:34 user nova-compute[70645]:       <source dev="/dev/sdd"/>
Jul 24 15:22:34 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:22:34 user nova-compute[70645]:       <serial>522a34ad-ddc7-46af-a1d9-303cc6291529</serial>
Jul 24 15:22:34 user nova-compute[70645]:     </disk>
Jul 24 15:22:34 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:22:34 user nova-compute[70645]:       <mac address="fa:16:3e:4a:52:2e"/>
Jul 24 15:22:34 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:22:34 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:22:34 user nova-compute[70645]:       <target dev="tap7e03b403-4c"/>
Jul 24 15:22:34 user nova-compute[70645]:     </interface>
Jul 24 15:22:34 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:22:34 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/1ebc6554-5bd9-4fa2-8f10-1be458e549f0/console.log" append="off"/>
Jul 24 15:22:34 user nova-compute[70645]:     </serial>
Jul 24 15:22:34 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:22:34 user nova-compute[70645]:     <video>
Jul 24 15:22:34 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:22:34 user nova-compute[70645]:     </video>
Jul 24 15:22:34 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:22:34 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:22:34 user nova-compute[70645]:     </rng>
Jul 24 15:22:34 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:22:34 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:22:34 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:22:34 user nova-compute[70645]:     </memballoon>
Jul 24 15:22:34 user nova-compute[70645]:   </devices>
Jul 24 15:22:34 user nova-compute[70645]: </domain>
Jul 24 15:22:34 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1666749559',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1666749559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1666749559',id=46,image_ref='91a7b7ba-1070-4181-a3ba-28230b91bf59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4wAuVx/0nRWcLuXDaB5PTg0f+7+0MzMXILlfxGNBfFeN9I4XHz13lAl1krhipvnrSr0FJvc6czZnL+ELSoFms961sLPZxTZYu7QMKYpGYvbJKT6WFMJPlIwHqwtKxhmw==',key_name='tempest-keypair-1983985393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-b46c4hqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1424700934',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=1ebc6554-5bd9-4fa2-8f10-1be458e549f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "address": "fa:16:3e:4a:52:2e", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e03b403-4c", "ovs_interfaceid": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "address": "fa:16:3e:4a:52:2e", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e03b403-4c", "ovs_interfaceid": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=7e03b403-4c19-4d5a-b4fd-9847cea2ba4e,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e03b403-4c') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG os_vif [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=7e03b403-4c19-4d5a-b4fd-9847cea2ba4e,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e03b403-4c') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e03b403-4c, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e03b403-4c, col_values=(('external_ids', {'iface-id': '7e03b403-4c19-4d5a-b4fd-9847cea2ba4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:52:2e', 'vm-uuid': '1ebc6554-5bd9-4fa2-8f10-1be458e549f0'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:34 user nova-compute[70645]: INFO os_vif [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=7e03b403-4c19-4d5a-b4fd-9847cea2ba4e,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e03b403-4c')
Jul 24 15:22:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:22:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No VIF found with MAC fa:16:3e:4a:52:2e, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:22:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-ef82636e-0760-4d54-8a2b-9bcd7793d925 req-06b7a81e-af50-467b-8adb-14bd7d3f4a1f service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Received event network-vif-plugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:22:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ef82636e-0760-4d54-8a2b-9bcd7793d925 req-06b7a81e-af50-467b-8adb-14bd7d3f4a1f service nova] Acquiring lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:22:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ef82636e-0760-4d54-8a2b-9bcd7793d925 req-06b7a81e-af50-467b-8adb-14bd7d3f4a1f service nova] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:22:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ef82636e-0760-4d54-8a2b-9bcd7793d925 req-06b7a81e-af50-467b-8adb-14bd7d3f4a1f service nova] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:22:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-ef82636e-0760-4d54-8a2b-9bcd7793d925 req-06b7a81e-af50-467b-8adb-14bd7d3f4a1f service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] No waiting events found dispatching network-vif-plugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:22:36 user nova-compute[70645]: WARNING nova.compute.manager [req-ef82636e-0760-4d54-8a2b-9bcd7793d925 req-06b7a81e-af50-467b-8adb-14bd7d3f4a1f service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Received unexpected event network-vif-plugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e for instance with vm_state building and task_state spawning.
Jul 24 15:22:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212158.3784084, 1ebc6554-5bd9-4fa2-8f10-1be458e549f0 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:22:38 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] VM Resumed (Lifecycle Event)
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:22:38 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Instance spawned successfully.
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:22:38 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212158.3785682, 1ebc6554-5bd9-4fa2-8f10-1be458e549f0 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:22:38 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] VM Started (Lifecycle Event)
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:22:38 user nova-compute[70645]: INFO nova.compute.manager [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Took 5.00 seconds to spawn the instance on the hypervisor.
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:22:38 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-456589e9-d6cd-4277-994e-eea103f00028 req-7c292ef3-43a6-4490-9ef2-d287c36a4917 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Received event network-vif-plugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-456589e9-d6cd-4277-994e-eea103f00028 req-7c292ef3-43a6-4490-9ef2-d287c36a4917 service nova] Acquiring lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-456589e9-d6cd-4277-994e-eea103f00028 req-7c292ef3-43a6-4490-9ef2-d287c36a4917 service nova] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-456589e9-d6cd-4277-994e-eea103f00028 req-7c292ef3-43a6-4490-9ef2-d287c36a4917 service nova] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:22:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-456589e9-d6cd-4277-994e-eea103f00028 req-7c292ef3-43a6-4490-9ef2-d287c36a4917 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] No waiting events found dispatching network-vif-plugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:22:38 user nova-compute[70645]: WARNING nova.compute.manager [req-456589e9-d6cd-4277-994e-eea103f00028 req-7c292ef3-43a6-4490-9ef2-d287c36a4917 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Received unexpected event network-vif-plugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e for instance with vm_state building and task_state spawning.
Jul 24 15:22:38 user nova-compute[70645]: INFO nova.compute.manager [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Took 25.63 seconds to build instance.
Jul 24 15:22:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-52ee308a-bcbc-4e3e-9228-f7ecfbc6a1fb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.794s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:22:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:40 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:22:40 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:22:40 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:22:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:22:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:22:40 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:22:40 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:22:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:22:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:22:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:22:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:22:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:22:42 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:22:42 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:22:42 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8427MB free_disk=25.270904541015625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance fa864eae-0ab7-4009-bd0c-b376075b1b2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 19fb3cac-76eb-4603-9810-911c200ad2e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 45b46753-8117-432b-b3ba-e241728b5957 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 1ebc6554-5bd9-4fa2-8f10-1be458e549f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:22:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:22:43 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:22:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:22:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:22:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:22:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:22:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Updating instance_info_cache with network_info: [{"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:22:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:22:44 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:22:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:22:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:22:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:22:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:22:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:22:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:22:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:22:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:22:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:23:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "45b46753-8117-432b-b3ba-e241728b5957" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:23:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:23:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "45b46753-8117-432b-b3ba-e241728b5957-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:23:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:23:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:23:22 user nova-compute[70645]: INFO nova.compute.manager [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Terminating instance
Jul 24 15:23:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:23:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-80349909-8be7-4916-b584-93d6dc135361 req-0cea4d7c-fe06-4e70-9c8e-cbfa979c56aa service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Received event network-vif-unplugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-80349909-8be7-4916-b584-93d6dc135361 req-0cea4d7c-fe06-4e70-9c8e-cbfa979c56aa service nova] Acquiring lock "45b46753-8117-432b-b3ba-e241728b5957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-80349909-8be7-4916-b584-93d6dc135361 req-0cea4d7c-fe06-4e70-9c8e-cbfa979c56aa service nova] Lock "45b46753-8117-432b-b3ba-e241728b5957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-80349909-8be7-4916-b584-93d6dc135361 req-0cea4d7c-fe06-4e70-9c8e-cbfa979c56aa service nova] Lock "45b46753-8117-432b-b3ba-e241728b5957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-80349909-8be7-4916-b584-93d6dc135361 req-0cea4d7c-fe06-4e70-9c8e-cbfa979c56aa service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] No waiting events found dispatching network-vif-unplugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-80349909-8be7-4916-b584-93d6dc135361 req-0cea4d7c-fe06-4e70-9c8e-cbfa979c56aa service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Received event network-vif-unplugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:23 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Instance destroyed successfully.
Jul 24 15:23:23 user nova-compute[70645]: DEBUG nova.objects.instance [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'resources' on Instance uuid 45b46753-8117-432b-b3ba-e241728b5957 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1122565484',display_name='tempest-AttachVolumeNegativeTest-server-1122565484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1122565484',id=45,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByjR//jir28H+zO2ZEhm5fcsFi74neiUuUQT7wmcgQA6OGbmwOm+mmrHFRVz1E6sLeiY9BvWG2XfS3WqkFKuYlW3KgFeb+OnYUEaVb+/recddCRJhWDEYzIZ2DW0injQg==',key_name='tempest-keypair-144309234',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:20:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-wdwvqmxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:20:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=45b46753-8117-432b-b3ba-e241728b5957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "address": "fa:16:3e:c7:a7:c1", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b7474e-56", "ovs_interfaceid": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "address": "fa:16:3e:c7:a7:c1", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b7474e-56", "ovs_interfaceid": "67b7474e-56a0-4d40-8b7f-1c18e2c6e549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a7:c1,bridge_name='br-int',has_traffic_filtering=True,id=67b7474e-56a0-4d40-8b7f-1c18e2c6e549,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b7474e-56') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG os_vif [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a7:c1,bridge_name='br-int',has_traffic_filtering=True,id=67b7474e-56a0-4d40-8b7f-1c18e2c6e549,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b7474e-56') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67b7474e-56, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:23 user nova-compute[70645]: INFO os_vif [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a7:c1,bridge_name='br-int',has_traffic_filtering=True,id=67b7474e-56a0-4d40-8b7f-1c18e2c6e549,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b7474e-56')
Jul 24 15:23:23 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Deleting instance files /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957_del
Jul 24 15:23:23 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Deletion of /opt/stack/data/nova/instances/45b46753-8117-432b-b3ba-e241728b5957_del complete
Jul 24 15:23:23 user nova-compute[70645]: INFO nova.compute.manager [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 24 15:23:23 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:23:23 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 45b46753-8117-432b-b3ba-e241728b5957] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:23:24 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:23:24 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Took 0.85 seconds to deallocate network for instance.
Jul 24 15:23:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:23:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:23:24 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:23:24 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:23:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:23:24 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Deleted allocations for instance 45b46753-8117-432b-b3ba-e241728b5957
Jul 24 15:23:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-a77666ce-de75-4af9-9932-b78fba382b23 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "45b46753-8117-432b-b3ba-e241728b5957" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:23:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-5a17b079-edc5-4756-9e4c-85ad558ffc55 req-1e72d6ac-1547-4285-9c47-10e07177b3fc service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Received event network-vif-plugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:23:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5a17b079-edc5-4756-9e4c-85ad558ffc55 req-1e72d6ac-1547-4285-9c47-10e07177b3fc service nova] Acquiring lock "45b46753-8117-432b-b3ba-e241728b5957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:23:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5a17b079-edc5-4756-9e4c-85ad558ffc55 req-1e72d6ac-1547-4285-9c47-10e07177b3fc service nova] Lock "45b46753-8117-432b-b3ba-e241728b5957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:23:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5a17b079-edc5-4756-9e4c-85ad558ffc55 req-1e72d6ac-1547-4285-9c47-10e07177b3fc service nova] Lock "45b46753-8117-432b-b3ba-e241728b5957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:23:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-5a17b079-edc5-4756-9e4c-85ad558ffc55 req-1e72d6ac-1547-4285-9c47-10e07177b3fc service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] No waiting events found dispatching network-vif-plugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:23:25 user nova-compute[70645]: WARNING nova.compute.manager [req-5a17b079-edc5-4756-9e4c-85ad558ffc55 req-1e72d6ac-1547-4285-9c47-10e07177b3fc service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Received unexpected event network-vif-plugged-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 for instance with vm_state deleted and task_state None.
Jul 24 15:23:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-5a17b079-edc5-4756-9e4c-85ad558ffc55 req-1e72d6ac-1547-4285-9c47-10e07177b3fc service nova] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Received event network-vif-deleted-67b7474e-56a0-4d40-8b7f-1c18e2c6e549 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:23:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-96842327-a789-4070-90c6-19860940ee95 req-0b3aff0d-23bb-44b5-a28d-67aaa2210460 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-changed-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:23:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-96842327-a789-4070-90c6-19860940ee95 req-0b3aff0d-23bb-44b5-a28d-67aaa2210460 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Refreshing instance network info cache due to event network-changed-c49723c2-20d7-4b28-b6df-d23b9af56066. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:23:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-96842327-a789-4070-90c6-19860940ee95 req-0b3aff0d-23bb-44b5-a28d-67aaa2210460 service nova] Acquiring lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:23:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-96842327-a789-4070-90c6-19860940ee95 req-0b3aff0d-23bb-44b5-a28d-67aaa2210460 service nova] Acquired lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:23:33 user nova-compute[70645]: DEBUG nova.network.neutron [req-96842327-a789-4070-90c6-19860940ee95 req-0b3aff0d-23bb-44b5-a28d-67aaa2210460 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Refreshing network info cache for port c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-96842327-a789-4070-90c6-19860940ee95 req-0b3aff0d-23bb-44b5-a28d-67aaa2210460 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updated VIF entry in instance network info cache for port c49723c2-20d7-4b28-b6df-d23b9af56066. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-96842327-a789-4070-90c6-19860940ee95 req-0b3aff0d-23bb-44b5-a28d-67aaa2210460 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updating instance_info_cache with network_info: [{"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-96842327-a789-4070-90c6-19860940ee95 req-0b3aff0d-23bb-44b5-a28d-67aaa2210460 service nova] Releasing lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-6fbe0359-ebc8-40d7-a2a5-54fc40052b48 req-2210af1c-bfe1-4bfd-942c-16a49122ec72 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-changed-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-6fbe0359-ebc8-40d7-a2a5-54fc40052b48 req-2210af1c-bfe1-4bfd-942c-16a49122ec72 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Refreshing instance network info cache due to event network-changed-c49723c2-20d7-4b28-b6df-d23b9af56066. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6fbe0359-ebc8-40d7-a2a5-54fc40052b48 req-2210af1c-bfe1-4bfd-942c-16a49122ec72 service nova] Acquiring lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6fbe0359-ebc8-40d7-a2a5-54fc40052b48 req-2210af1c-bfe1-4bfd-942c-16a49122ec72 service nova] Acquired lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-6fbe0359-ebc8-40d7-a2a5-54fc40052b48 req-2210af1c-bfe1-4bfd-942c-16a49122ec72 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Refreshing network info cache for port c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:23:34 user nova-compute[70645]: INFO nova.compute.manager [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Detaching volume 9a1394bf-bda6-494f-9d02-a34640b6a0da
Jul 24 15:23:34 user nova-compute[70645]: INFO nova.virt.block_device [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Attempting to driver detach volume 9a1394bf-bda6-494f-9d02-a34640b6a0da from mountpoint /dev/vdb
Jul 24 15:23:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Attempting to detach device vdb from instance fa864eae-0ab7-4009-bd0c-b376075b1b2a from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:23:34 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:23:34 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:23:34 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:23:34 user nova-compute[70645]:   <serial>9a1394bf-bda6-494f-9d02-a34640b6a0da</serial>
Jul 24 15:23:34 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:23:34 user nova-compute[70645]: </disk>
Jul 24 15:23:34 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:23:34 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Successfully detached device vdb from instance fa864eae-0ab7-4009-bd0c-b376075b1b2a from the persistent domain config.
Jul 24 15:23:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa864eae-0ab7-4009-bd0c-b376075b1b2a from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:23:34 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:23:34 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:23:34 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:23:34 user nova-compute[70645]:   <serial>9a1394bf-bda6-494f-9d02-a34640b6a0da</serial>
Jul 24 15:23:34 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:23:34 user nova-compute[70645]: </disk>
Jul 24 15:23:34 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-6fbe0359-ebc8-40d7-a2a5-54fc40052b48 req-2210af1c-bfe1-4bfd-942c-16a49122ec72 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updated VIF entry in instance network info cache for port c49723c2-20d7-4b28-b6df-d23b9af56066. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:23:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-6fbe0359-ebc8-40d7-a2a5-54fc40052b48 req-2210af1c-bfe1-4bfd-942c-16a49122ec72 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updating instance_info_cache with network_info: [{"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6fbe0359-ebc8-40d7-a2a5-54fc40052b48 req-2210af1c-bfe1-4bfd-942c-16a49122ec72 service nova] Releasing lock "refresh_cache-fa864eae-0ab7-4009-bd0c-b376075b1b2a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690212215.271313, fa864eae-0ab7-4009-bd0c-b376075b1b2a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa864eae-0ab7-4009-bd0c-b376075b1b2a {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:23:35 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Successfully detached device vdb from instance fa864eae-0ab7-4009-bd0c-b376075b1b2a from the live domain config.
Jul 24 15:23:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OphUFwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:23:35 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24603e1-b668-472e-aaa4-b1196defec47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[646aa6bb-e9d3-4c40-95f9-f8d074d1f4e8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:23:35 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:23:35 user nova-compute[70645]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 (non-flash)
Jul 24 15:23:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:23:35 user nova-compute[70645]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da (non-flash)
Jul 24 15:23:35 user nova-compute[70645]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 (non-flash)
Jul 24 15:23:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba841a55a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38f4e0e-2320-4af4-999c-799f4a6876f5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[485a7443-af2a-477b-b094-4dcc88433e5e]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e505b6d8-0edf-41b6-831c-7f89b86c0233]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbd1636-9562-46c1-89e9-1bec1d9db5f6]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c267525-2ff2-4701-815d-335271973683]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2f1322-4c24-43c8-a38b-e191ca5ddf0a]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da, portal: 172.16.0.220,3260]
Jul 24 15:23:35 user nova-compute[70645]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da, portal: 172.16.0.220,3260] successful.
Jul 24 15:23:35 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a1394bf-bda6-494f-9d02-a34640b6a0da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a9ac4-b5f9-4570-8a4f-81bcf5853bac]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] <== disconnect_volume: return (271ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:23:35 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:23:36 user nova-compute[70645]: DEBUG nova.objects.instance [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'flavor' on Instance uuid fa864eae-0ab7-4009-bd0c-b376075b1b2a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:23:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-195faded-09a9-493e-8345-a7d00c720964 tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.594s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:23:38 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690212203.504699, 45b46753-8117-432b-b3ba-e241728b5957 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:23:38 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 45b46753-8117-432b-b3ba-e241728b5957] VM Stopped (Lifecycle Event)
Jul 24 15:23:38 user nova-compute[70645]: DEBUG nova.compute.manager [None req-66ae1f8e-66d7-4655-a51f-618e86b1e83e None None] [instance: 45b46753-8117-432b-b3ba-e241728b5957] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:23:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:23:42 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:23:42 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:23:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:23:42 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:23:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:23:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:23:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:23:42 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:43 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:23:43 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:23:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8555MB free_disk=25.29766845703125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance fa864eae-0ab7-4009-bd0c-b376075b1b2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 19fb3cac-76eb-4603-9810-911c200ad2e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 1ebc6554-5bd9-4fa2-8f10-1be458e549f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:23:43 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:23:44 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:23:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:23:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:23:44 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:23:44 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 15:23:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:23:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:23:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:23:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:23:44 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 15:23:44 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] There are 0 instances to clean {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 15:23:45 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:23:45 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:23:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:23:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:23:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:23:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:23:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:23:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:23:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:23:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:01 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-a64f2c2b-4239-4845-8a0f-ce89eca78642 req-ece6e3d0-8610-4587-b6a1-7ba08f099606 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Received event network-changed-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-a64f2c2b-4239-4845-8a0f-ce89eca78642 req-ece6e3d0-8610-4587-b6a1-7ba08f099606 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Refreshing instance network info cache due to event network-changed-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a64f2c2b-4239-4845-8a0f-ce89eca78642 req-ece6e3d0-8610-4587-b6a1-7ba08f099606 service nova] Acquiring lock "refresh_cache-1ebc6554-5bd9-4fa2-8f10-1be458e549f0" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a64f2c2b-4239-4845-8a0f-ce89eca78642 req-ece6e3d0-8610-4587-b6a1-7ba08f099606 service nova] Acquired lock "refresh_cache-1ebc6554-5bd9-4fa2-8f10-1be458e549f0" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG nova.network.neutron [req-a64f2c2b-4239-4845-8a0f-ce89eca78642 req-ece6e3d0-8610-4587-b6a1-7ba08f099606 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Refreshing network info cache for port 7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG nova.network.neutron [req-a64f2c2b-4239-4845-8a0f-ce89eca78642 req-ece6e3d0-8610-4587-b6a1-7ba08f099606 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Updated VIF entry in instance network info cache for port 7e03b403-4c19-4d5a-b4fd-9847cea2ba4e. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG nova.network.neutron [req-a64f2c2b-4239-4845-8a0f-ce89eca78642 req-ece6e3d0-8610-4587-b6a1-7ba08f099606 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Updating instance_info_cache with network_info: [{"id": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "address": "fa:16:3e:4a:52:2e", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e03b403-4c", "ovs_interfaceid": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-a64f2c2b-4239-4845-8a0f-ce89eca78642 req-ece6e3d0-8610-4587-b6a1-7ba08f099606 service nova] Releasing lock "refresh_cache-1ebc6554-5bd9-4fa2-8f10-1be458e549f0" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:04 user nova-compute[70645]: INFO nova.compute.manager [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Terminating instance
Jul 24 15:24:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-597ec979-f355-4aab-9c25-c710e0032149 req-9314e0cb-2035-44ef-8dfc-8cabd7d3fb46 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Received event network-vif-unplugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-597ec979-f355-4aab-9c25-c710e0032149 req-9314e0cb-2035-44ef-8dfc-8cabd7d3fb46 service nova] Acquiring lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-597ec979-f355-4aab-9c25-c710e0032149 req-9314e0cb-2035-44ef-8dfc-8cabd7d3fb46 service nova] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-597ec979-f355-4aab-9c25-c710e0032149 req-9314e0cb-2035-44ef-8dfc-8cabd7d3fb46 service nova] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-597ec979-f355-4aab-9c25-c710e0032149 req-9314e0cb-2035-44ef-8dfc-8cabd7d3fb46 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] No waiting events found dispatching network-vif-unplugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-597ec979-f355-4aab-9c25-c710e0032149 req-9314e0cb-2035-44ef-8dfc-8cabd7d3fb46 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Received event network-vif-unplugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Instance destroyed successfully.
Jul 24 15:24:05 user nova-compute[70645]: DEBUG nova.objects.instance [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'resources' on Instance uuid 1ebc6554-5bd9-4fa2-8f10-1be458e549f0 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1666749559',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1666749559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1666749559',id=46,image_ref='91a7b7ba-1070-4181-a3ba-28230b91bf59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4wAuVx/0nRWcLuXDaB5PTg0f+7+0MzMXILlfxGNBfFeN9I4XHz13lAl1krhipvnrSr0FJvc6czZnL+ELSoFms961sLPZxTZYu7QMKYpGYvbJKT6WFMJPlIwHqwtKxhmw==',key_name='tempest-keypair-1983985393',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:22:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-b46c4hqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1424700934',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=1ebc6554-5bd9-4fa2-8f10-1be458e549f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "address": "fa:16:3e:4a:52:2e", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e03b403-4c", "ovs_interfaceid": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "address": "fa:16:3e:4a:52:2e", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e03b403-4c", "ovs_interfaceid": "7e03b403-4c19-4d5a-b4fd-9847cea2ba4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=7e03b403-4c19-4d5a-b4fd-9847cea2ba4e,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e03b403-4c') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_vif [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=7e03b403-4c19-4d5a-b4fd-9847cea2ba4e,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e03b403-4c') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e03b403-4c, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:24:05 user nova-compute[70645]: INFO os_vif [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=7e03b403-4c19-4d5a-b4fd-9847cea2ba4e,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e03b403-4c')
Jul 24 15:24:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMZclnLo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:24:05 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f59057-bb6a-407b-a6de-73e9c48e05ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[855839a7-ba47-4c57-af87-05e77ce100b6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:24:05 user nova-compute[70645]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 (non-flash)
Jul 24 15:24:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:24:05 user nova-compute[70645]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 (non-flash)
Jul 24 15:24:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba84227c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529'): ({'sdd'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Removing single pathed devices sdd {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be48e04-b625-4ab1-95a4-b99c8eedf970]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc8f00b-26cc-4526-a3fa-7c70f8a0dba7]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flushing IO for device /dev/sdd {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c0f39b-b531-47f7-8f42-3829b0a87c55]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d393c1-54b5-4523-802b-fe44ec11d711]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ab2b64bd', '/dev/disk/by-id/scsi-1SCST_BIOab2b64bd-7a1ae8dd3eb193c4', '/dev/disk/by-id/scsi-23761316165386464') {{(pid=81509) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9721655-8861-4039-bbc8-10128124e21b]: (4, None) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8a2fbb-140e-49fc-8654-0b7202648321]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b247ff10-e0fc-49f6-8956-a433a569b60a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529, portal: 172.16.0.220,3260]
Jul 24 15:24:05 user nova-compute[70645]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529, portal: 172.16.0.220,3260] successful.
Jul 24 15:24:05 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522a34ad-ddc7-46af-a1d9-303cc6291529 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[80604230-4c02-4024-902c-a2c66b8f00b1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== disconnect_volume: return (269ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:24:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:24:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Deleting instance files /opt/stack/data/nova/instances/1ebc6554-5bd9-4fa2-8f10-1be458e549f0_del
Jul 24 15:24:05 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Deletion of /opt/stack/data/nova/instances/1ebc6554-5bd9-4fa2-8f10-1be458e549f0_del complete
Jul 24 15:24:06 user nova-compute[70645]: INFO nova.compute.manager [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 24 15:24:06 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:24:06 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:24:06 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:24:06 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:24:06 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Took 0.85 seconds to deallocate network for instance.
Jul 24 15:24:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-2eb92a52-2380-42af-b500-6565943b5a59 req-e36c7abc-1b9d-4b32-9350-24f7fe664db9 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Received event network-vif-deleted-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:24:06 user nova-compute[70645]: INFO nova.compute.manager [req-2eb92a52-2380-42af-b500-6565943b5a59 req-e36c7abc-1b9d-4b32-9350-24f7fe664db9 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Neutron deleted interface 7e03b403-4c19-4d5a-b4fd-9847cea2ba4e; detaching it from the instance and deleting it from the info cache
Jul 24 15:24:06 user nova-compute[70645]: DEBUG nova.network.neutron [req-2eb92a52-2380-42af-b500-6565943b5a59 req-e36c7abc-1b9d-4b32-9350-24f7fe664db9 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:24:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-2eb92a52-2380-42af-b500-6565943b5a59 req-e36c7abc-1b9d-4b32-9350-24f7fe664db9 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Detach interface failed, port_id=7e03b403-4c19-4d5a-b4fd-9847cea2ba4e, reason: Instance 1ebc6554-5bd9-4fa2-8f10-1be458e549f0 could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:24:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-6310e525-5c3a-45c1-8931-e0c0ef2d5e04 req-a2307a9d-e97d-44cc-a7ad-e446fded3857 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Received event network-vif-plugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:24:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6310e525-5c3a-45c1-8931-e0c0ef2d5e04 req-a2307a9d-e97d-44cc-a7ad-e446fded3857 service nova] Acquiring lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6310e525-5c3a-45c1-8931-e0c0ef2d5e04 req-a2307a9d-e97d-44cc-a7ad-e446fded3857 service nova] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-6310e525-5c3a-45c1-8931-e0c0ef2d5e04 req-a2307a9d-e97d-44cc-a7ad-e446fded3857 service nova] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-6310e525-5c3a-45c1-8931-e0c0ef2d5e04 req-a2307a9d-e97d-44cc-a7ad-e446fded3857 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] No waiting events found dispatching network-vif-plugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:24:07 user nova-compute[70645]: WARNING nova.compute.manager [req-6310e525-5c3a-45c1-8931-e0c0ef2d5e04 req-a2307a9d-e97d-44cc-a7ad-e446fded3857 service nova] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Received unexpected event network-vif-plugged-7e03b403-4c19-4d5a-b4fd-9847cea2ba4e for instance with vm_state active and task_state deleting.
Jul 24 15:24:07 user nova-compute[70645]: INFO nova.compute.manager [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Took 0.72 seconds to detach 1 volumes for instance.
Jul 24 15:24:07 user nova-compute[70645]: DEBUG nova.compute.manager [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Deleting volume: 522a34ad-ddc7-46af-a1d9-303cc6291529 {{(pid=70645) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 15:24:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:07 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:24:07 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:24:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:07 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Deleted allocations for instance 1ebc6554-5bd9-4fa2-8f10-1be458e549f0
Jul 24 15:24:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-ba9e803e-b021-44d4-aed7-759a463011db tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "1ebc6554-5bd9-4fa2-8f10-1be458e549f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.172s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70645) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 15:24:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:24:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:16 user nova-compute[70645]: DEBUG nova.compute.manager [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:24:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:16 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:24:16 user nova-compute[70645]: INFO nova.compute.claims [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Claim successful on node user
Jul 24 15:24:16 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:24:16 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.network.neutron [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:24:17 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.policy [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07525ed635a7407495f38c9556e7ce59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7f4608ea8242fcbacfba6754da3628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.compute.manager [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:24:17 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Creating image(s)
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "/opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "/opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "/opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.130s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk 1073741824" returned: 0 in 0.053s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.131s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Cannot resize image /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.objects.instance [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'migration_context' on Instance uuid 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Ensure instance console log exists: /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:17 user nova-compute[70645]: DEBUG nova.network.neutron [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Successfully created port: e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Successfully updated port: e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquired lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-506f0578-7117-464a-ba4c-9e8296691ac6 req-d6309800-a260-46d4-834e-3157d1c1dba5 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Received event network-changed-e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG nova.compute.manager [req-506f0578-7117-464a-ba4c-9e8296691ac6 req-d6309800-a260-46d4-834e-3157d1c1dba5 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Refreshing instance network info cache due to event network-changed-e24dee70-e54f-4a1d-a4e7-3261e82b016b. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-506f0578-7117-464a-ba4c-9e8296691ac6 req-d6309800-a260-46d4-834e-3157d1c1dba5 service nova] Acquiring lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG nova.network.neutron [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Updating instance_info_cache with network_info: [{"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Releasing lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG nova.compute.manager [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Instance network_info: |[{"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-506f0578-7117-464a-ba4c-9e8296691ac6 req-d6309800-a260-46d4-834e-3157d1c1dba5 service nova] Acquired lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG nova.network.neutron [req-506f0578-7117-464a-ba4c-9e8296691ac6 req-d6309800-a260-46d4-834e-3157d1c1dba5 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Refreshing network info cache for port e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:24:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Start _get_guest_xml network_info=[{"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:24:19 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:24:19 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-606022030',display_name='tempest-AttachVolumeNegativeTest-server-606022030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-606022030',id=47,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcnvXM/txPzODA1VBU8jz85Gv66/tdoOART+1ix8MOfoU/37QkWttIU6ZT6GPrh55uWfhgFEylNDIWil+13F6+/DrBfW8FVxad7od/Av2bxIRZgXVjOii93clavoUb/ng==',key_name='tempest-keypair-1101283843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-xmhbjiso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:24:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=264d0360-0ecc-4dcb-ba4b-8ad37cceeed6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:07:0c,bridge_name='br-int',has_traffic_filtering=True,id=e24dee70-e54f-4a1d-a4e7-3261e82b016b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape24dee70-e5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.objects.instance [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'pci_devices' on Instance uuid 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:24:19 user nova-compute[70645]:   <uuid>264d0360-0ecc-4dcb-ba4b-8ad37cceeed6</uuid>
Jul 24 15:24:19 user nova-compute[70645]:   <name>instance-0000002f</name>
Jul 24 15:24:19 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:24:19 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:24:19 user nova-compute[70645]:   <metadata>
Jul 24 15:24:19 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:24:19 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:24:19 user nova-compute[70645]:       <nova:name>tempest-AttachVolumeNegativeTest-server-606022030</nova:name>
Jul 24 15:24:19 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:24:19</nova:creationTime>
Jul 24 15:24:19 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:24:19 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:24:19 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:24:19 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:24:19 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:24:19 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:24:19 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:24:19 user nova-compute[70645]:       <nova:owner>
Jul 24 15:24:19 user nova-compute[70645]:         <nova:user uuid="07525ed635a7407495f38c9556e7ce59">tempest-AttachVolumeNegativeTest-508353659-project-member</nova:user>
Jul 24 15:24:19 user nova-compute[70645]:         <nova:project uuid="de7f4608ea8242fcbacfba6754da3628">tempest-AttachVolumeNegativeTest-508353659</nova:project>
Jul 24 15:24:19 user nova-compute[70645]:       </nova:owner>
Jul 24 15:24:19 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:24:19 user nova-compute[70645]:       <nova:ports>
Jul 24 15:24:19 user nova-compute[70645]:         <nova:port uuid="e24dee70-e54f-4a1d-a4e7-3261e82b016b">
Jul 24 15:24:19 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 15:24:19 user nova-compute[70645]:         </nova:port>
Jul 24 15:24:19 user nova-compute[70645]:       </nova:ports>
Jul 24 15:24:19 user nova-compute[70645]:     </nova:instance>
Jul 24 15:24:19 user nova-compute[70645]:   </metadata>
Jul 24 15:24:19 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:24:19 user nova-compute[70645]:     <system>
Jul 24 15:24:19 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:24:19 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:24:19 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:24:19 user nova-compute[70645]:       <entry name="serial">264d0360-0ecc-4dcb-ba4b-8ad37cceeed6</entry>
Jul 24 15:24:19 user nova-compute[70645]:       <entry name="uuid">264d0360-0ecc-4dcb-ba4b-8ad37cceeed6</entry>
Jul 24 15:24:19 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:24:19 user nova-compute[70645]:     </system>
Jul 24 15:24:19 user nova-compute[70645]:   </sysinfo>
Jul 24 15:24:19 user nova-compute[70645]:   <os>
Jul 24 15:24:19 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:24:19 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:24:19 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:24:19 user nova-compute[70645]:   </os>
Jul 24 15:24:19 user nova-compute[70645]:   <features>
Jul 24 15:24:19 user nova-compute[70645]:     <acpi/>
Jul 24 15:24:19 user nova-compute[70645]:     <apic/>
Jul 24 15:24:19 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:24:19 user nova-compute[70645]:   </features>
Jul 24 15:24:19 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:24:19 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:24:19 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:24:19 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:24:19 user nova-compute[70645]:   </clock>
Jul 24 15:24:19 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:24:19 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:24:19 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:24:19 user nova-compute[70645]:   </cpu>
Jul 24 15:24:19 user nova-compute[70645]:   <devices>
Jul 24 15:24:19 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:24:19 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:24:19 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk"/>
Jul 24 15:24:19 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:24:19 user nova-compute[70645]:     </disk>
Jul 24 15:24:19 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:24:19 user nova-compute[70645]:       <mac address="fa:16:3e:f1:07:0c"/>
Jul 24 15:24:19 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:24:19 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:24:19 user nova-compute[70645]:       <target dev="tape24dee70-e5"/>
Jul 24 15:24:19 user nova-compute[70645]:     </interface>
Jul 24 15:24:19 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:24:19 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/console.log" append="off"/>
Jul 24 15:24:19 user nova-compute[70645]:     </serial>
Jul 24 15:24:19 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:24:19 user nova-compute[70645]:     <video>
Jul 24 15:24:19 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:24:19 user nova-compute[70645]:     </video>
Jul 24 15:24:19 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:24:19 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:24:19 user nova-compute[70645]:     </rng>
Jul 24 15:24:19 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:24:19 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:24:19 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:24:19 user nova-compute[70645]:     </memballoon>
Jul 24 15:24:19 user nova-compute[70645]:   </devices>
Jul 24 15:24:19 user nova-compute[70645]: </domain>
Jul 24 15:24:19 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-606022030',display_name='tempest-AttachVolumeNegativeTest-server-606022030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-606022030',id=47,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcnvXM/txPzODA1VBU8jz85Gv66/tdoOART+1ix8MOfoU/37QkWttIU6ZT6GPrh55uWfhgFEylNDIWil+13F6+/DrBfW8FVxad7od/Av2bxIRZgXVjOii93clavoUb/ng==',key_name='tempest-keypair-1101283843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-xmhbjiso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:24:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=264d0360-0ecc-4dcb-ba4b-8ad37cceeed6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:07:0c,bridge_name='br-int',has_traffic_filtering=True,id=e24dee70-e54f-4a1d-a4e7-3261e82b016b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape24dee70-e5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG os_vif [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:07:0c,bridge_name='br-int',has_traffic_filtering=True,id=e24dee70-e54f-4a1d-a4e7-3261e82b016b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape24dee70-e5') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape24dee70-e5, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape24dee70-e5, col_values=(('external_ids', {'iface-id': 'e24dee70-e54f-4a1d-a4e7-3261e82b016b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:07:0c', 'vm-uuid': '264d0360-0ecc-4dcb-ba4b-8ad37cceeed6'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:19 user nova-compute[70645]: INFO os_vif [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:07:0c,bridge_name='br-int',has_traffic_filtering=True,id=e24dee70-e54f-4a1d-a4e7-3261e82b016b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape24dee70-e5')
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No VIF found with MAC fa:16:3e:f1:07:0c, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.network.neutron [req-506f0578-7117-464a-ba4c-9e8296691ac6 req-d6309800-a260-46d4-834e-3157d1c1dba5 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Updated VIF entry in instance network info cache for port e24dee70-e54f-4a1d-a4e7-3261e82b016b. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG nova.network.neutron [req-506f0578-7117-464a-ba4c-9e8296691ac6 req-d6309800-a260-46d4-834e-3157d1c1dba5 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Updating instance_info_cache with network_info: [{"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:24:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-506f0578-7117-464a-ba4c-9e8296691ac6 req-d6309800-a260-46d4-834e-3157d1c1dba5 service nova] Releasing lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:24:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:20 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690212245.6476796, 1ebc6554-5bd9-4fa2-8f10-1be458e549f0 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:24:20 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] VM Stopped (Lifecycle Event)
Jul 24 15:24:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-38f329ab-d48e-42b6-a8d2-d1bbf5523b46 None None] [instance: 1ebc6554-5bd9-4fa2-8f10-1be458e549f0] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:24:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-c6a72ea9-da73-4a2c-b3e8-4a4851a80d74 req-984b1f44-df62-4bb0-9455-edbf44aef8b5 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Received event network-vif-plugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:24:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c6a72ea9-da73-4a2c-b3e8-4a4851a80d74 req-984b1f44-df62-4bb0-9455-edbf44aef8b5 service nova] Acquiring lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c6a72ea9-da73-4a2c-b3e8-4a4851a80d74 req-984b1f44-df62-4bb0-9455-edbf44aef8b5 service nova] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c6a72ea9-da73-4a2c-b3e8-4a4851a80d74 req-984b1f44-df62-4bb0-9455-edbf44aef8b5 service nova] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:20 user nova-compute[70645]: DEBUG nova.compute.manager [req-c6a72ea9-da73-4a2c-b3e8-4a4851a80d74 req-984b1f44-df62-4bb0-9455-edbf44aef8b5 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] No waiting events found dispatching network-vif-plugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:24:20 user nova-compute[70645]: WARNING nova.compute.manager [req-c6a72ea9-da73-4a2c-b3e8-4a4851a80d74 req-984b1f44-df62-4bb0-9455-edbf44aef8b5 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Received unexpected event network-vif-plugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b for instance with vm_state building and task_state spawning.
Jul 24 15:24:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212262.7245555, 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:24:22 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] VM Resumed (Lifecycle Event)
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:24:22 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Instance spawned successfully.
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:24:22 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212262.7293992, 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:24:22 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] VM Started (Lifecycle Event)
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:24:22 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-45a8536f-6b00-4c97-babe-ff4a8c8dce24 req-58b69814-acdc-4970-b10a-a79629376fd6 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Received event network-vif-plugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-45a8536f-6b00-4c97-babe-ff4a8c8dce24 req-58b69814-acdc-4970-b10a-a79629376fd6 service nova] Acquiring lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-45a8536f-6b00-4c97-babe-ff4a8c8dce24 req-58b69814-acdc-4970-b10a-a79629376fd6 service nova] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-45a8536f-6b00-4c97-babe-ff4a8c8dce24 req-58b69814-acdc-4970-b10a-a79629376fd6 service nova] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.compute.manager [req-45a8536f-6b00-4c97-babe-ff4a8c8dce24 req-58b69814-acdc-4970-b10a-a79629376fd6 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] No waiting events found dispatching network-vif-plugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:24:22 user nova-compute[70645]: WARNING nova.compute.manager [req-45a8536f-6b00-4c97-babe-ff4a8c8dce24 req-58b69814-acdc-4970-b10a-a79629376fd6 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Received unexpected event network-vif-plugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b for instance with vm_state building and task_state spawning.
Jul 24 15:24:22 user nova-compute[70645]: INFO nova.compute.manager [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Took 5.66 seconds to spawn the instance on the hypervisor.
Jul 24 15:24:22 user nova-compute[70645]: DEBUG nova.compute.manager [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:24:22 user nova-compute[70645]: INFO nova.compute.manager [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Took 6.19 seconds to build instance.
Jul 24 15:24:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-b92bc16e-8f1d-447f-bc67-248a8ff47639 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.286s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:28 user nova-compute[70645]: INFO nova.compute.manager [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Terminating instance
Jul 24 15:24:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-b4dc36e3-1cda-4a0d-8dfb-b63ec2d5962b req-a6881cb1-7b73-4acb-841b-c3a5321f85c1 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-vif-unplugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b4dc36e3-1cda-4a0d-8dfb-b63ec2d5962b req-a6881cb1-7b73-4acb-841b-c3a5321f85c1 service nova] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b4dc36e3-1cda-4a0d-8dfb-b63ec2d5962b req-a6881cb1-7b73-4acb-841b-c3a5321f85c1 service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b4dc36e3-1cda-4a0d-8dfb-b63ec2d5962b req-a6881cb1-7b73-4acb-841b-c3a5321f85c1 service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-b4dc36e3-1cda-4a0d-8dfb-b63ec2d5962b req-a6881cb1-7b73-4acb-841b-c3a5321f85c1 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] No waiting events found dispatching network-vif-unplugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:24:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-b4dc36e3-1cda-4a0d-8dfb-b63ec2d5962b req-a6881cb1-7b73-4acb-841b-c3a5321f85c1 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-vif-unplugged-c49723c2-20d7-4b28-b6df-d23b9af56066 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:29 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Instance destroyed successfully.
Jul 24 15:24:29 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lazy-loading 'resources' on Instance uuid fa864eae-0ab7-4009-bd0c-b376075b1b2a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:19:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1197085571',display_name='tempest-TestMinimumBasicScenario-server-1197085571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1197085571',id=43,image_ref='def31d05-c06f-4c0e-b00a-b137119b8694',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2VyWR6BN6uVmHBE1Fe48Xsr4SthamiDiZHHpk5egwQ99QQ2tHdqcSJ/0BPH2Z42/1t0qf5XPa+CUb7dPp6McRSRw4/usDMJ8RkA/waJc4UTkOwhuoV0upYs3n0FZ0Sw==',key_name='tempest-TestMinimumBasicScenario-1740538353',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2699829f2bd4b638132ea38a8f28b13',ramdisk_id='',reservation_id='r-aojtsxj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='def31d05-c06f-4c0e-b00a-b137119b8694',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-55837010',owner_user_name='tempest-TestMinimumBasicScenario-55837010-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:21:49Z,user_data=None,user_id='782bcf41be0f4fcf881d467649ef5206',uuid=fa864eae-0ab7-4009-bd0c-b376075b1b2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converting VIF {"id": "c49723c2-20d7-4b28-b6df-d23b9af56066", "address": "fa:16:3e:2f:2d:15", "network": {"id": "2a6881db-c321-42ab-b69d-b302fbcad127", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-544130606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2699829f2bd4b638132ea38a8f28b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49723c2-20", "ovs_interfaceid": "c49723c2-20d7-4b28-b6df-d23b9af56066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:2d:15,bridge_name='br-int',has_traffic_filtering=True,id=c49723c2-20d7-4b28-b6df-d23b9af56066,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49723c2-20') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG os_vif [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:2d:15,bridge_name='br-int',has_traffic_filtering=True,id=c49723c2-20d7-4b28-b6df-d23b9af56066,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49723c2-20') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc49723c2-20, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:24:29 user nova-compute[70645]: INFO os_vif [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:2d:15,bridge_name='br-int',has_traffic_filtering=True,id=c49723c2-20d7-4b28-b6df-d23b9af56066,network=Network(2a6881db-c321-42ab-b69d-b302fbcad127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49723c2-20')
Jul 24 15:24:29 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Deleting instance files /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a_del
Jul 24 15:24:29 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Deletion of /opt/stack/data/nova/instances/fa864eae-0ab7-4009-bd0c-b376075b1b2a_del complete
Jul 24 15:24:29 user nova-compute[70645]: INFO nova.compute.manager [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 24 15:24:29 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:24:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-013d6f43-1101-42da-bfa8-78bf2a54ab16 req-9fd177b2-ba2e-4f89-b77b-32360b69e37c service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-vif-deleted-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:24:29 user nova-compute[70645]: INFO nova.compute.manager [req-013d6f43-1101-42da-bfa8-78bf2a54ab16 req-9fd177b2-ba2e-4f89-b77b-32360b69e37c service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Neutron deleted interface c49723c2-20d7-4b28-b6df-d23b9af56066; detaching it from the instance and deleting it from the info cache
Jul 24 15:24:29 user nova-compute[70645]: DEBUG nova.network.neutron [req-013d6f43-1101-42da-bfa8-78bf2a54ab16 req-9fd177b2-ba2e-4f89-b77b-32360b69e37c service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:24:29 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Took 0.55 seconds to deallocate network for instance.
Jul 24 15:24:29 user nova-compute[70645]: DEBUG nova.compute.manager [req-013d6f43-1101-42da-bfa8-78bf2a54ab16 req-9fd177b2-ba2e-4f89-b77b-32360b69e37c service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Detach interface failed, port_id=c49723c2-20d7-4b28-b6df-d23b9af56066, reason: Instance fa864eae-0ab7-4009-bd0c-b376075b1b2a could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:24:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:30 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:24:30 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:24:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:30 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Deleted allocations for instance fa864eae-0ab7-4009-bd0c-b376075b1b2a
Jul 24 15:24:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4e0f09ac-49da-4961-9283-6b815adeaf6a tempest-TestMinimumBasicScenario-55837010 tempest-TestMinimumBasicScenario-55837010-project-member] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.830s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-edfba8a9-2ade-43dc-91b5-37195c9d3802 req-7d286d47-00c6-4f44-bcce-2d7b5857c504 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:24:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-edfba8a9-2ade-43dc-91b5-37195c9d3802 req-7d286d47-00c6-4f44-bcce-2d7b5857c504 service nova] Acquiring lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-edfba8a9-2ade-43dc-91b5-37195c9d3802 req-7d286d47-00c6-4f44-bcce-2d7b5857c504 service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:30 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-edfba8a9-2ade-43dc-91b5-37195c9d3802 req-7d286d47-00c6-4f44-bcce-2d7b5857c504 service nova] Lock "fa864eae-0ab7-4009-bd0c-b376075b1b2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:30 user nova-compute[70645]: DEBUG nova.compute.manager [req-edfba8a9-2ade-43dc-91b5-37195c9d3802 req-7d286d47-00c6-4f44-bcce-2d7b5857c504 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] No waiting events found dispatching network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:24:30 user nova-compute[70645]: WARNING nova.compute.manager [req-edfba8a9-2ade-43dc-91b5-37195c9d3802 req-7d286d47-00c6-4f44-bcce-2d7b5857c504 service nova] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Received unexpected event network-vif-plugged-c49723c2-20d7-4b28-b6df-d23b9af56066 for instance with vm_state deleted and task_state None.
Jul 24 15:24:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:42 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:24:42 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:42 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:43 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:24:43 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:24:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8611MB free_disk=25.296924591064453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 19fb3cac-76eb-4603-9810-911c200ad2e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:24:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:24:44 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing inventories for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 15:24:44 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Updating ProviderTree inventory for provider a0cf5b80-69d2-4191-894e-a498eab7d688 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 15:24:44 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 15:24:44 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing aggregate associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, aggregates: None {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 15:24:44 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing trait associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 15:24:44 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:24:44 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:24:44 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:24:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:44 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690212269.3220563, fa864eae-0ab7-4009-bd0c-b376075b1b2a => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:24:44 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] VM Stopped (Lifecycle Event)
Jul 24 15:24:44 user nova-compute[70645]: DEBUG nova.compute.manager [None req-5e59ca40-5d7f-4bf7-86a2-f316938f070a None None] [instance: fa864eae-0ab7-4009-bd0c-b376075b1b2a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:24:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:45 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:24:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:24:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:24:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:24:45 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:24:45 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 19fb3cac-76eb-4603-9810-911c200ad2e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:24:46 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Updating instance_info_cache with network_info: [{"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:24:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-19fb3cac-76eb-4603-9810-911c200ad2e1" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:24:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:24:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:47 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "19fb3cac-76eb-4603-9810-911c200ad2e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:57 user nova-compute[70645]: INFO nova.compute.manager [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Terminating instance
Jul 24 15:24:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-1fecc63d-353b-460e-a464-5bbbdbeb2a2e req-1c05a6f5-6575-43ea-8c41-a4e51977777b service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Received event network-vif-unplugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1fecc63d-353b-460e-a464-5bbbdbeb2a2e req-1c05a6f5-6575-43ea-8c41-a4e51977777b service nova] Acquiring lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1fecc63d-353b-460e-a464-5bbbdbeb2a2e req-1c05a6f5-6575-43ea-8c41-a4e51977777b service nova] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1fecc63d-353b-460e-a464-5bbbdbeb2a2e req-1c05a6f5-6575-43ea-8c41-a4e51977777b service nova] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-1fecc63d-353b-460e-a464-5bbbdbeb2a2e req-1c05a6f5-6575-43ea-8c41-a4e51977777b service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] No waiting events found dispatching network-vif-unplugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:24:57 user nova-compute[70645]: DEBUG nova.compute.manager [req-1fecc63d-353b-460e-a464-5bbbdbeb2a2e req-1c05a6f5-6575-43ea-8c41-a4e51977777b service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Received event network-vif-unplugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:24:58 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Instance destroyed successfully.
Jul 24 15:24:58 user nova-compute[70645]: DEBUG nova.objects.instance [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'resources' on Instance uuid 19fb3cac-76eb-4603-9810-911c200ad2e1 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-865840531',display_name='tempest-TestVolumeBootPattern-volume-backed-server-865840531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-865840531',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeVsqEf+Am9qW4zLqQYrSNITPpUc+StQfb3KdxIlRzdFLy2HDE1ldOuuVuWnuhbVB9/UQW/ZBDRrW7SMy7fTa2GsvMBAq3IIh1iHlSXrR4AdhfWoY6U5D7+6XfjGYG9sg==',key_name='tempest-keypair-880243971',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:20:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-dz9y0iq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:20:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=19fb3cac-76eb-4603-9810-911c200ad2e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "address": "fa:16:3e:ef:08:88", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46421e4f-a9", "ovs_interfaceid": "46421e4f-a99a-4ff8-90fb-4eb56a9203d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:08:88,bridge_name='br-int',has_traffic_filtering=True,id=46421e4f-a99a-4ff8-90fb-4eb56a9203d5,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46421e4f-a9') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_vif [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:08:88,bridge_name='br-int',has_traffic_filtering=True,id=46421e4f-a99a-4ff8-90fb-4eb56a9203d5,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46421e4f-a9') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46421e4f-a9, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:24:58 user nova-compute[70645]: INFO os_vif [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:08:88,bridge_name='br-int',has_traffic_filtering=True,id=46421e4f-a99a-4ff8-90fb-4eb56a9203d5,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46421e4f-a9')
Jul 24 15:24:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISXZUBot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:24:58 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39309be-ec9a-4e84-a978-056589420643]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b09cc9f-8ca0-4575-b200-cfb663a35cf0]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:24:58 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c (non-flash)
Jul 24 15:24:58 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba60678940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f0ce21-5092-4db0-9824-4fece7e39466]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f75665b-78b3-4490-828c-1871badf204a]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedcb92a-d2a8-4705-a7b8-8c219e305eb2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce0bbb8-fcf4-4100-a7f2-921aaf19d8b8]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ccb70a61', '/dev/disk/by-id/scsi-1SCST_BIOccb70a61-8863dd40b864e338', '/dev/disk/by-id/scsi-23838363364643430') {{(pid=81509) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a288ac44-dcca-4ded-b9c6-a77976e95190]: (4, None) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[295c0953-a3bb-4891-87f0-910a7b234d63]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[313acb60-481b-42eb-a4e2-c671a1cf1aa2]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c, portal: 172.16.0.220,3260]
Jul 24 15:24:58 user nova-compute[70645]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c, portal: 172.16.0.220,3260] successful.
Jul 24 15:24:58 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5e887c-e759-400b-993e-9c667cd65f6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddb46bb-0db2-4ae4-bc0f-dcb48947eaf9]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== disconnect_volume: return (266ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:24:58 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Deleting instance files /opt/stack/data/nova/instances/19fb3cac-76eb-4603-9810-911c200ad2e1_del
Jul 24 15:24:58 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Deletion of /opt/stack/data/nova/instances/19fb3cac-76eb-4603-9810-911c200ad2e1_del complete
Jul 24 15:24:58 user nova-compute[70645]: INFO nova.compute.manager [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Took 1.10 seconds to destroy the instance on the hypervisor.
Jul 24 15:24:58 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:24:58 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:24:59 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:24:59 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Took 0.77 seconds to deallocate network for instance.
Jul 24 15:25:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-5553316c-cd1c-428f-9e60-8a2aa34e0f18 req-2a8eb469-8475-4971-90b0-82ecace8ec50 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Received event network-vif-plugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:25:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5553316c-cd1c-428f-9e60-8a2aa34e0f18 req-2a8eb469-8475-4971-90b0-82ecace8ec50 service nova] Acquiring lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5553316c-cd1c-428f-9e60-8a2aa34e0f18 req-2a8eb469-8475-4971-90b0-82ecace8ec50 service nova] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5553316c-cd1c-428f-9e60-8a2aa34e0f18 req-2a8eb469-8475-4971-90b0-82ecace8ec50 service nova] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-5553316c-cd1c-428f-9e60-8a2aa34e0f18 req-2a8eb469-8475-4971-90b0-82ecace8ec50 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] No waiting events found dispatching network-vif-plugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:25:00 user nova-compute[70645]: WARNING nova.compute.manager [req-5553316c-cd1c-428f-9e60-8a2aa34e0f18 req-2a8eb469-8475-4971-90b0-82ecace8ec50 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Received unexpected event network-vif-plugged-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 for instance with vm_state active and task_state deleting.
Jul 24 15:25:00 user nova-compute[70645]: DEBUG nova.compute.manager [req-5553316c-cd1c-428f-9e60-8a2aa34e0f18 req-2a8eb469-8475-4971-90b0-82ecace8ec50 service nova] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Received event network-vif-deleted-46421e4f-a99a-4ff8-90fb-4eb56a9203d5 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:25:00 user nova-compute[70645]: INFO nova.compute.manager [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Took 0.70 seconds to detach 1 volumes for instance.
Jul 24 15:25:00 user nova-compute[70645]: DEBUG nova.compute.manager [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Deleting volume: 6d5e887c-e759-400b-993e-9c667cd65f6c {{(pid=70645) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 15:25:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:00 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:25:00 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:25:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:00 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Deleted allocations for instance 19fb3cac-76eb-4603-9810-911c200ad2e1
Jul 24 15:25:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-7b16f7e8-5138-46e1-8244-df886dcb8657 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "19fb3cac-76eb-4603-9810-911c200ad2e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.953s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:25:13 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690212298.2776723, 19fb3cac-76eb-4603-9810-911c200ad2e1 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:25:13 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] VM Stopped (Lifecycle Event)
Jul 24 15:25:13 user nova-compute[70645]: DEBUG nova.compute.manager [None req-921dd893-f9b9-48c3-a2b4-eacef7d0bb07 None None] [instance: 19fb3cac-76eb-4603-9810-911c200ad2e1] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:25:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:25:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:25:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:25:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:25:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:25:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:43 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:25:43 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:25:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:25:43 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:25:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:43 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:25:44 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:25:44 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:25:44 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=25.325054168701172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 38fd9832-4406-49fb-bd96-265c8e74740d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1724}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG nova.compute.manager [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:44 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:25:44 user nova-compute[70645]: INFO nova.compute.claims [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Claim successful on node user
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.network.neutron [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:25:45 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.policy [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '302fa8ddc4f44c1d951b6ab06fecde6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a453eb6891a54cd48ec92ee0ad6b01f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:25:45 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Creating image(s)
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "/opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "/opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "/opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.151s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk 1073741824" returned: 0 in 0.053s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Cannot resize image /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:25:45 user nova-compute[70645]: DEBUG nova.objects.instance [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'migration_context' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Ensure instance console log exists: /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG nova.network.neutron [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Successfully created port: 9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Updating instance_info_cache with network_info: [{"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG nova.network.neutron [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Successfully updated port: 9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquired lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG nova.network.neutron [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG nova.compute.manager [req-2cb7ae51-f1a4-44c6-ab92-c56521a5ec9f req-85550e66-2bf1-4bb3-a143-6d88dabbc775 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Received event network-changed-9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG nova.compute.manager [req-2cb7ae51-f1a4-44c6-ab92-c56521a5ec9f req-85550e66-2bf1-4bb3-a143-6d88dabbc775 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Refreshing instance network info cache due to event network-changed-9c82f167-a114-424c-ab4b-0b69db3724e3. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2cb7ae51-f1a4-44c6-ab92-c56521a5ec9f req-85550e66-2bf1-4bb3-a143-6d88dabbc775 service nova] Acquiring lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:25:46 user nova-compute[70645]: DEBUG nova.network.neutron [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.network.neutron [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updating instance_info_cache with network_info: [{"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Releasing lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Instance network_info: |[{"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2cb7ae51-f1a4-44c6-ab92-c56521a5ec9f req-85550e66-2bf1-4bb3-a143-6d88dabbc775 service nova] Acquired lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-2cb7ae51-f1a4-44c6-ab92-c56521a5ec9f req-85550e66-2bf1-4bb3-a143-6d88dabbc775 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Refreshing network info cache for port 9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Start _get_guest_xml network_info=[{"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:25:47 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:25:47 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:25:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-284966359',display_name='tempest-SnapshotDataIntegrityTests-server-284966359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-284966359',id=48,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj8TRnEwVYL1ULNHPLlkc0xuOaLAM2eV+8/X8KJQ+Yqnh4tlACFgN33I2QmamWsSpGNZCVcJF1ZoHxKvoZAsaZ+AzW+WYMnFDsDTd1j9v8ncupz62qV8D01Kj86xYGVMg==',key_name='tempest-keypair-1798457285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a453eb6891a54cd48ec92ee0ad6b01f8',ramdisk_id='',reservation_id='r-jgq7k1fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1036015419',owner_user_name='tempest-SnapshotDataIntegrityTests-1036015419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302fa8ddc4f44c1d951b6ab06fecde6b',uuid=38fd9832-4406-49fb-bd96-265c8e74740d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Converting VIF {"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e0:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c82f167-a114-424c-ab4b-0b69db3724e3,network=Network(21d2a7ea-b5fc-4d19-8147-20255fe4cd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c82f167-a1') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.objects.instance [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'pci_devices' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:25:47 user nova-compute[70645]:   <uuid>38fd9832-4406-49fb-bd96-265c8e74740d</uuid>
Jul 24 15:25:47 user nova-compute[70645]:   <name>instance-00000030</name>
Jul 24 15:25:47 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:25:47 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:25:47 user nova-compute[70645]:   <metadata>
Jul 24 15:25:47 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:25:47 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:25:47 user nova-compute[70645]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-284966359</nova:name>
Jul 24 15:25:47 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:25:47</nova:creationTime>
Jul 24 15:25:47 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:25:47 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:25:47 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:25:47 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:25:47 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:25:47 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:25:47 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:25:47 user nova-compute[70645]:       <nova:owner>
Jul 24 15:25:47 user nova-compute[70645]:         <nova:user uuid="302fa8ddc4f44c1d951b6ab06fecde6b">tempest-SnapshotDataIntegrityTests-1036015419-project-member</nova:user>
Jul 24 15:25:47 user nova-compute[70645]:         <nova:project uuid="a453eb6891a54cd48ec92ee0ad6b01f8">tempest-SnapshotDataIntegrityTests-1036015419</nova:project>
Jul 24 15:25:47 user nova-compute[70645]:       </nova:owner>
Jul 24 15:25:47 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:25:47 user nova-compute[70645]:       <nova:ports>
Jul 24 15:25:47 user nova-compute[70645]:         <nova:port uuid="9c82f167-a114-424c-ab4b-0b69db3724e3">
Jul 24 15:25:47 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 15:25:47 user nova-compute[70645]:         </nova:port>
Jul 24 15:25:47 user nova-compute[70645]:       </nova:ports>
Jul 24 15:25:47 user nova-compute[70645]:     </nova:instance>
Jul 24 15:25:47 user nova-compute[70645]:   </metadata>
Jul 24 15:25:47 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:25:47 user nova-compute[70645]:     <system>
Jul 24 15:25:47 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:25:47 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:25:47 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:25:47 user nova-compute[70645]:       <entry name="serial">38fd9832-4406-49fb-bd96-265c8e74740d</entry>
Jul 24 15:25:47 user nova-compute[70645]:       <entry name="uuid">38fd9832-4406-49fb-bd96-265c8e74740d</entry>
Jul 24 15:25:47 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:25:47 user nova-compute[70645]:     </system>
Jul 24 15:25:47 user nova-compute[70645]:   </sysinfo>
Jul 24 15:25:47 user nova-compute[70645]:   <os>
Jul 24 15:25:47 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:25:47 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:25:47 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:25:47 user nova-compute[70645]:   </os>
Jul 24 15:25:47 user nova-compute[70645]:   <features>
Jul 24 15:25:47 user nova-compute[70645]:     <acpi/>
Jul 24 15:25:47 user nova-compute[70645]:     <apic/>
Jul 24 15:25:47 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:25:47 user nova-compute[70645]:   </features>
Jul 24 15:25:47 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:25:47 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:25:47 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:25:47 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:25:47 user nova-compute[70645]:   </clock>
Jul 24 15:25:47 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:25:47 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:25:47 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:25:47 user nova-compute[70645]:   </cpu>
Jul 24 15:25:47 user nova-compute[70645]:   <devices>
Jul 24 15:25:47 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:25:47 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:25:47 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk"/>
Jul 24 15:25:47 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:25:47 user nova-compute[70645]:     </disk>
Jul 24 15:25:47 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:25:47 user nova-compute[70645]:       <mac address="fa:16:3e:f4:e0:f4"/>
Jul 24 15:25:47 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:25:47 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:25:47 user nova-compute[70645]:       <target dev="tap9c82f167-a1"/>
Jul 24 15:25:47 user nova-compute[70645]:     </interface>
Jul 24 15:25:47 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:25:47 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/console.log" append="off"/>
Jul 24 15:25:47 user nova-compute[70645]:     </serial>
Jul 24 15:25:47 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:25:47 user nova-compute[70645]:     <video>
Jul 24 15:25:47 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:25:47 user nova-compute[70645]:     </video>
Jul 24 15:25:47 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:25:47 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:25:47 user nova-compute[70645]:     </rng>
Jul 24 15:25:47 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:25:47 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:25:47 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:25:47 user nova-compute[70645]:     </memballoon>
Jul 24 15:25:47 user nova-compute[70645]:   </devices>
Jul 24 15:25:47 user nova-compute[70645]: </domain>
Jul 24 15:25:47 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:25:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-284966359',display_name='tempest-SnapshotDataIntegrityTests-server-284966359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-284966359',id=48,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj8TRnEwVYL1ULNHPLlkc0xuOaLAM2eV+8/X8KJQ+Yqnh4tlACFgN33I2QmamWsSpGNZCVcJF1ZoHxKvoZAsaZ+AzW+WYMnFDsDTd1j9v8ncupz62qV8D01Kj86xYGVMg==',key_name='tempest-keypair-1798457285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a453eb6891a54cd48ec92ee0ad6b01f8',ramdisk_id='',reservation_id='r-jgq7k1fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1036015419',owner_user_name='tempest-SnapshotDataIntegrityTests-1036015419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302fa8ddc4f44c1d951b6ab06fecde6b',uuid=38fd9832-4406-49fb-bd96-265c8e74740d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Converting VIF {"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e0:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c82f167-a114-424c-ab4b-0b69db3724e3,network=Network(21d2a7ea-b5fc-4d19-8147-20255fe4cd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c82f167-a1') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG os_vif [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e0:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c82f167-a114-424c-ab4b-0b69db3724e3,network=Network(21d2a7ea-b5fc-4d19-8147-20255fe4cd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c82f167-a1') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c82f167-a1, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c82f167-a1, col_values=(('external_ids', {'iface-id': '9c82f167-a114-424c-ab4b-0b69db3724e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:e0:f4', 'vm-uuid': '38fd9832-4406-49fb-bd96-265c8e74740d'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:47 user nova-compute[70645]: INFO os_vif [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e0:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c82f167-a114-424c-ab4b-0b69db3724e3,network=Network(21d2a7ea-b5fc-4d19-8147-20255fe4cd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c82f167-a1')
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No VIF found with MAC fa:16:3e:f4:e0:f4, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-2cb7ae51-f1a4-44c6-ab92-c56521a5ec9f req-85550e66-2bf1-4bb3-a143-6d88dabbc775 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updated VIF entry in instance network info cache for port 9c82f167-a114-424c-ab4b-0b69db3724e3. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG nova.network.neutron [req-2cb7ae51-f1a4-44c6-ab92-c56521a5ec9f req-85550e66-2bf1-4bb3-a143-6d88dabbc775 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updating instance_info_cache with network_info: [{"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-2cb7ae51-f1a4-44c6-ab92-c56521a5ec9f req-85550e66-2bf1-4bb3-a143-6d88dabbc775 service nova] Releasing lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:25:47 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:25:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-3de26de3-bd52-4d34-941e-c97006ee83b4 req-6251120e-5c26-4276-9894-be6db43e5c71 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Received event network-vif-plugged-9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:25:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3de26de3-bd52-4d34-941e-c97006ee83b4 req-6251120e-5c26-4276-9894-be6db43e5c71 service nova] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3de26de3-bd52-4d34-941e-c97006ee83b4 req-6251120e-5c26-4276-9894-be6db43e5c71 service nova] Lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-3de26de3-bd52-4d34-941e-c97006ee83b4 req-6251120e-5c26-4276-9894-be6db43e5c71 service nova] Lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:48 user nova-compute[70645]: DEBUG nova.compute.manager [req-3de26de3-bd52-4d34-941e-c97006ee83b4 req-6251120e-5c26-4276-9894-be6db43e5c71 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] No waiting events found dispatching network-vif-plugged-9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:25:48 user nova-compute[70645]: WARNING nova.compute.manager [req-3de26de3-bd52-4d34-941e-c97006ee83b4 req-6251120e-5c26-4276-9894-be6db43e5c71 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Received unexpected event network-vif-plugged-9c82f167-a114-424c-ab4b-0b69db3724e3 for instance with vm_state building and task_state spawning.
Jul 24 15:25:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212350.6789634, 38fd9832-4406-49fb-bd96-265c8e74740d => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:25:50 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] VM Resumed (Lifecycle Event)
Jul 24 15:25:50 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Instance spawned successfully.
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:25:50 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212350.6802948, 38fd9832-4406-49fb-bd96-265c8e74740d => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:25:50 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] VM Started (Lifecycle Event)
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:25:50 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:25:50 user nova-compute[70645]: INFO nova.compute.manager [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Took 5.46 seconds to spawn the instance on the hypervisor.
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:25:50 user nova-compute[70645]: INFO nova.compute.manager [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Took 5.99 seconds to build instance.
Jul 24 15:25:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-51f73922-d3d3-48d6-aa26-f03bd98d0286 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.091s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-5dd263e1-f8b9-4021-9fd3-d52da11fec2b req-187ffc62-dd2c-43ef-a127-639bda4ba43d service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Received event network-vif-plugged-9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5dd263e1-f8b9-4021-9fd3-d52da11fec2b req-187ffc62-dd2c-43ef-a127-639bda4ba43d service nova] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5dd263e1-f8b9-4021-9fd3-d52da11fec2b req-187ffc62-dd2c-43ef-a127-639bda4ba43d service nova] Lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5dd263e1-f8b9-4021-9fd3-d52da11fec2b req-187ffc62-dd2c-43ef-a127-639bda4ba43d service nova] Lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-5dd263e1-f8b9-4021-9fd3-d52da11fec2b req-187ffc62-dd2c-43ef-a127-639bda4ba43d service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] No waiting events found dispatching network-vif-plugged-9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:25:50 user nova-compute[70645]: WARNING nova.compute.manager [req-5dd263e1-f8b9-4021-9fd3-d52da11fec2b req-187ffc62-dd2c-43ef-a127-639bda4ba43d service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Received unexpected event network-vif-plugged-9c82f167-a114-424c-ab4b-0b69db3724e3 for instance with vm_state active and task_state None.
Jul 24 15:25:52 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:25:57 user nova-compute[70645]: INFO nova.compute.claims [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Claim successful on node user
Jul 24 15:25:57 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:25:57 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:25:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:25:57 user nova-compute[70645]: INFO nova.virt.block_device [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Booting with volume ac230bca-69f7-4820-9891-383465fbeaea at /dev/vda
Jul 24 15:25:57 user nova-compute[70645]: DEBUG nova.policy [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a83e71e487ca401eb10e1d41d77b86fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92f320224c4b1e98b371f510a5e198', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG os_brick.utils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2776ba94-42b1-4197-aaee-e2b64f19bc5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:25:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d5fbe0-fdcb-4908-a199-3c2589ff4010]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcb9668-0b98-4d10-ab62-0eabd2a977a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1140a15b-649e-46f8-8d76-6557c6dd024e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:25:58 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:25:58 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[00122b35-15f4-4c40-b623-0f409129fd5f]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG os_brick.utils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Updating existing volume attachment record: 6cd20859-9ba7-453b-8132-94cdeeabd9a7 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:25:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Successfully created port: a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:25:59 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Successfully updated port: a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:25:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "refresh_cache-01a8fe31-5b12-4c12-b567-80073fcc1d6a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:25:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquired lock "refresh_cache-01a8fe31-5b12-4c12-b567-80073fcc1d6a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:25:59 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:25:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-5d7a5042-54b6-46ae-be77-198f89537faf req-1eae6dea-d237-47cd-b3cb-9cca95035989 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Received event network-changed-a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:25:59 user nova-compute[70645]: DEBUG nova.compute.manager [req-5d7a5042-54b6-46ae-be77-198f89537faf req-1eae6dea-d237-47cd-b3cb-9cca95035989 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Refreshing instance network info cache due to event network-changed-a2bb0354-0c14-4a8b-a819-160025fb1118. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:25:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5d7a5042-54b6-46ae-be77-198f89537faf req-1eae6dea-d237-47cd-b3cb-9cca95035989 service nova] Acquiring lock "refresh_cache-01a8fe31-5b12-4c12-b567-80073fcc1d6a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:25:59 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:26:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Updating instance_info_cache with network_info: [{"id": "a2bb0354-0c14-4a8b-a819-160025fb1118", "address": "fa:16:3e:c6:c1:75", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bb0354-0c", "ovs_interfaceid": "a2bb0354-0c14-4a8b-a819-160025fb1118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:26:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Releasing lock "refresh_cache-01a8fe31-5b12-4c12-b567-80073fcc1d6a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:26:00 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Instance network_info: |[{"id": "a2bb0354-0c14-4a8b-a819-160025fb1118", "address": "fa:16:3e:c6:c1:75", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bb0354-0c", "ovs_interfaceid": "a2bb0354-0c14-4a8b-a819-160025fb1118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:26:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5d7a5042-54b6-46ae-be77-198f89537faf req-1eae6dea-d237-47cd-b3cb-9cca95035989 service nova] Acquired lock "refresh_cache-01a8fe31-5b12-4c12-b567-80073fcc1d6a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:26:00 user nova-compute[70645]: DEBUG nova.network.neutron [req-5d7a5042-54b6-46ae-be77-198f89537faf req-1eae6dea-d237-47cd-b3cb-9cca95035989 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Refreshing network info cache for port a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:26:00 user nova-compute[70645]: DEBUG nova.network.neutron [req-5d7a5042-54b6-46ae-be77-198f89537faf req-1eae6dea-d237-47cd-b3cb-9cca95035989 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Updated VIF entry in instance network info cache for port a2bb0354-0c14-4a8b-a819-160025fb1118. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:26:00 user nova-compute[70645]: DEBUG nova.network.neutron [req-5d7a5042-54b6-46ae-be77-198f89537faf req-1eae6dea-d237-47cd-b3cb-9cca95035989 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Updating instance_info_cache with network_info: [{"id": "a2bb0354-0c14-4a8b-a819-160025fb1118", "address": "fa:16:3e:c6:c1:75", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bb0354-0c", "ovs_interfaceid": "a2bb0354-0c14-4a8b-a819-160025fb1118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:26:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5d7a5042-54b6-46ae-be77-198f89537faf req-1eae6dea-d237-47cd-b3cb-9cca95035989 service nova] Releasing lock "refresh_cache-01a8fe31-5b12-4c12-b567-80073fcc1d6a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:26:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:26:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:26:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Creating image(s)
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Ensure instance console log exists: /opt/stack/data/nova/instances/01a8fe31-5b12-4c12-b567-80073fcc1d6a/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Start _get_guest_xml network_info=[{"id": "a2bb0354-0c14-4a8b-a819-160025fb1118", "address": "fa:16:3e:c6:c1:75", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bb0354-0c", "ovs_interfaceid": "a2bb0354-0c14-4a8b-a819-160025fb1118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6cd20859-9ba7-453b-8132-94cdeeabd9a7', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwnvVkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01a8fe31-5b12-4c12-b567-80073fcc1d6a', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac230bca-69f7-4820-9891-383465fbeaea', 'serial': 'ac230bca-69f7-4820-9891-383465fbeaea'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:26:04 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:26:04 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwnvVkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:26:04 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:26:04 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:26:04 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2304f47-63bd-4937-b4e2-5956e01bc502]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:26:04 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdbba70-c6c4-4ac2-9a91-e5999aa78f08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea] added
Jul 24 15:26:04 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb76ffe-c9c5-4211-bb5d-37bbd95555da]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[35484123-7649-42ec-822e-177d83e504e4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjwnvVkQ {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjwnvVkQ" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea10bb1c-e729-4a2a-a8c3-caddf7ed28d0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RjwnvVkQ'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae93681-e685-49a2-885c-d76f6bab751d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a549bbe2-f8e0-45ce-9dbe-175c961f8036]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:26:04 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:26:04 user nova-compute[70645]:  {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:26:04 user nova-compute[70645]: WARNING os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 15:26:04 user nova-compute[70645]: 
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[240c4eeb-1a55-4ebc-a8b0-005e26791bfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260]
Jul 24 15:26:04 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260] successful.
Jul 24 15:26:04 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0450f1b0-d117-4171-8a82-91d0f510e5a8]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a30b25-c1da-47db-ae5f-3fb1da0944c6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:26:04 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:26:04 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4423f8c7-051b-49d5-b28d-e6b8d1d52719]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:26:04 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwnvVkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26238393363616132', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238393363616132', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:25:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1893336493',display_name='tempest-TestVolumeBootPattern-server-1893336493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1893336493',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTRyGHkNM/F7Uj8s1zbBGzq4u2ODBAATzdNxRyu6wHhbmJaesfIAOHgecueCfWN8rF4+FlyT1hvCe5vW8Raq9odIyX9yY69korPYjadjkJh7/JFICKyDrIiyoOtLEuJfw==',key_name='tempest-TestVolumeBootPattern-364022229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-nl7ahh04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:25:58Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=01a8fe31-5b12-4c12-b567-80073fcc1d6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2bb0354-0c14-4a8b-a819-160025fb1118", "address": "fa:16:3e:c6:c1:75", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bb0354-0c", "ovs_interfaceid": "a2bb0354-0c14-4a8b-a819-160025fb1118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "a2bb0354-0c14-4a8b-a819-160025fb1118", "address": "fa:16:3e:c6:c1:75", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bb0354-0c", "ovs_interfaceid": "a2bb0354-0c14-4a8b-a819-160025fb1118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c1:75,bridge_name='br-int',has_traffic_filtering=True,id=a2bb0354-0c14-4a8b-a819-160025fb1118,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bb0354-0c') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'pci_devices' on Instance uuid 01a8fe31-5b12-4c12-b567-80073fcc1d6a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:26:05 user nova-compute[70645]:   <uuid>01a8fe31-5b12-4c12-b567-80073fcc1d6a</uuid>
Jul 24 15:26:05 user nova-compute[70645]:   <name>instance-00000031</name>
Jul 24 15:26:05 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:26:05 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:26:05 user nova-compute[70645]:   <metadata>
Jul 24 15:26:05 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:26:05 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:26:05 user nova-compute[70645]:       <nova:name>tempest-TestVolumeBootPattern-server-1893336493</nova:name>
Jul 24 15:26:05 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:26:04</nova:creationTime>
Jul 24 15:26:05 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:26:05 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:26:05 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:26:05 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:26:05 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:26:05 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:26:05 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:26:05 user nova-compute[70645]:       <nova:owner>
Jul 24 15:26:05 user nova-compute[70645]:         <nova:user uuid="a83e71e487ca401eb10e1d41d77b86fe">tempest-TestVolumeBootPattern-1424700934-project-member</nova:user>
Jul 24 15:26:05 user nova-compute[70645]:         <nova:project uuid="6f92f320224c4b1e98b371f510a5e198">tempest-TestVolumeBootPattern-1424700934</nova:project>
Jul 24 15:26:05 user nova-compute[70645]:       </nova:owner>
Jul 24 15:26:05 user nova-compute[70645]:       <nova:ports>
Jul 24 15:26:05 user nova-compute[70645]:         <nova:port uuid="a2bb0354-0c14-4a8b-a819-160025fb1118">
Jul 24 15:26:05 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 15:26:05 user nova-compute[70645]:         </nova:port>
Jul 24 15:26:05 user nova-compute[70645]:       </nova:ports>
Jul 24 15:26:05 user nova-compute[70645]:     </nova:instance>
Jul 24 15:26:05 user nova-compute[70645]:   </metadata>
Jul 24 15:26:05 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:26:05 user nova-compute[70645]:     <system>
Jul 24 15:26:05 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:26:05 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:26:05 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:26:05 user nova-compute[70645]:       <entry name="serial">01a8fe31-5b12-4c12-b567-80073fcc1d6a</entry>
Jul 24 15:26:05 user nova-compute[70645]:       <entry name="uuid">01a8fe31-5b12-4c12-b567-80073fcc1d6a</entry>
Jul 24 15:26:05 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:26:05 user nova-compute[70645]:     </system>
Jul 24 15:26:05 user nova-compute[70645]:   </sysinfo>
Jul 24 15:26:05 user nova-compute[70645]:   <os>
Jul 24 15:26:05 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:26:05 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:26:05 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:26:05 user nova-compute[70645]:   </os>
Jul 24 15:26:05 user nova-compute[70645]:   <features>
Jul 24 15:26:05 user nova-compute[70645]:     <acpi/>
Jul 24 15:26:05 user nova-compute[70645]:     <apic/>
Jul 24 15:26:05 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:26:05 user nova-compute[70645]:   </features>
Jul 24 15:26:05 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:26:05 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:26:05 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:26:05 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:26:05 user nova-compute[70645]:   </clock>
Jul 24 15:26:05 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:26:05 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:26:05 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:26:05 user nova-compute[70645]:   </cpu>
Jul 24 15:26:05 user nova-compute[70645]:   <devices>
Jul 24 15:26:05 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:26:05 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:26:05 user nova-compute[70645]:       <source dev="/dev/sdb"/>
Jul 24 15:26:05 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:26:05 user nova-compute[70645]:       <serial>ac230bca-69f7-4820-9891-383465fbeaea</serial>
Jul 24 15:26:05 user nova-compute[70645]:     </disk>
Jul 24 15:26:05 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:26:05 user nova-compute[70645]:       <mac address="fa:16:3e:c6:c1:75"/>
Jul 24 15:26:05 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:26:05 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:26:05 user nova-compute[70645]:       <target dev="tapa2bb0354-0c"/>
Jul 24 15:26:05 user nova-compute[70645]:     </interface>
Jul 24 15:26:05 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:26:05 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/01a8fe31-5b12-4c12-b567-80073fcc1d6a/console.log" append="off"/>
Jul 24 15:26:05 user nova-compute[70645]:     </serial>
Jul 24 15:26:05 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:26:05 user nova-compute[70645]:     <video>
Jul 24 15:26:05 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:26:05 user nova-compute[70645]:     </video>
Jul 24 15:26:05 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:26:05 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:26:05 user nova-compute[70645]:     </rng>
Jul 24 15:26:05 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:26:05 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:26:05 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:26:05 user nova-compute[70645]:     </memballoon>
Jul 24 15:26:05 user nova-compute[70645]:   </devices>
Jul 24 15:26:05 user nova-compute[70645]: </domain>
Jul 24 15:26:05 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:25:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1893336493',display_name='tempest-TestVolumeBootPattern-server-1893336493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1893336493',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTRyGHkNM/F7Uj8s1zbBGzq4u2ODBAATzdNxRyu6wHhbmJaesfIAOHgecueCfWN8rF4+FlyT1hvCe5vW8Raq9odIyX9yY69korPYjadjkJh7/JFICKyDrIiyoOtLEuJfw==',key_name='tempest-TestVolumeBootPattern-364022229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-nl7ahh04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:25:58Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=01a8fe31-5b12-4c12-b567-80073fcc1d6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2bb0354-0c14-4a8b-a819-160025fb1118", "address": "fa:16:3e:c6:c1:75", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bb0354-0c", "ovs_interfaceid": "a2bb0354-0c14-4a8b-a819-160025fb1118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "a2bb0354-0c14-4a8b-a819-160025fb1118", "address": "fa:16:3e:c6:c1:75", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bb0354-0c", "ovs_interfaceid": "a2bb0354-0c14-4a8b-a819-160025fb1118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c1:75,bridge_name='br-int',has_traffic_filtering=True,id=a2bb0354-0c14-4a8b-a819-160025fb1118,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bb0354-0c') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG os_vif [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c1:75,bridge_name='br-int',has_traffic_filtering=True,id=a2bb0354-0c14-4a8b-a819-160025fb1118,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bb0354-0c') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2bb0354-0c, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2bb0354-0c, col_values=(('external_ids', {'iface-id': 'a2bb0354-0c14-4a8b-a819-160025fb1118', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:c1:75', 'vm-uuid': '01a8fe31-5b12-4c12-b567-80073fcc1d6a'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:05 user nova-compute[70645]: INFO os_vif [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c1:75,bridge_name='br-int',has_traffic_filtering=True,id=a2bb0354-0c14-4a8b-a819-160025fb1118,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bb0354-0c')
Jul 24 15:26:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:26:05 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No VIF found with MAC fa:16:3e:c6:c1:75, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:26:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-9f2b3efe-340d-4752-89b6-bf6a12ec2f83 req-5646d0c2-4468-4d8e-ad08-ef2251657a2a service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Received event network-vif-plugged-a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:26:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9f2b3efe-340d-4752-89b6-bf6a12ec2f83 req-5646d0c2-4468-4d8e-ad08-ef2251657a2a service nova] Acquiring lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:26:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9f2b3efe-340d-4752-89b6-bf6a12ec2f83 req-5646d0c2-4468-4d8e-ad08-ef2251657a2a service nova] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:26:07 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9f2b3efe-340d-4752-89b6-bf6a12ec2f83 req-5646d0c2-4468-4d8e-ad08-ef2251657a2a service nova] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:26:07 user nova-compute[70645]: DEBUG nova.compute.manager [req-9f2b3efe-340d-4752-89b6-bf6a12ec2f83 req-5646d0c2-4468-4d8e-ad08-ef2251657a2a service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] No waiting events found dispatching network-vif-plugged-a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:26:07 user nova-compute[70645]: WARNING nova.compute.manager [req-9f2b3efe-340d-4752-89b6-bf6a12ec2f83 req-5646d0c2-4468-4d8e-ad08-ef2251657a2a service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Received unexpected event network-vif-plugged-a2bb0354-0c14-4a8b-a819-160025fb1118 for instance with vm_state building and task_state spawning.
Jul 24 15:26:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:07 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:08 user nova-compute[70645]: DEBUG nova.compute.manager [req-772a14fb-cd5d-41e5-ba5a-d3929395c729 req-bbd4e137-991c-4699-8a33-a8622693efa7 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Received event network-changed-e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:26:08 user nova-compute[70645]: DEBUG nova.compute.manager [req-772a14fb-cd5d-41e5-ba5a-d3929395c729 req-bbd4e137-991c-4699-8a33-a8622693efa7 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Refreshing instance network info cache due to event network-changed-e24dee70-e54f-4a1d-a4e7-3261e82b016b. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:26:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-772a14fb-cd5d-41e5-ba5a-d3929395c729 req-bbd4e137-991c-4699-8a33-a8622693efa7 service nova] Acquiring lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:26:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-772a14fb-cd5d-41e5-ba5a-d3929395c729 req-bbd4e137-991c-4699-8a33-a8622693efa7 service nova] Acquired lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:26:08 user nova-compute[70645]: DEBUG nova.network.neutron [req-772a14fb-cd5d-41e5-ba5a-d3929395c729 req-bbd4e137-991c-4699-8a33-a8622693efa7 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Refreshing network info cache for port e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:26:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:08 user nova-compute[70645]: DEBUG nova.network.neutron [req-772a14fb-cd5d-41e5-ba5a-d3929395c729 req-bbd4e137-991c-4699-8a33-a8622693efa7 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Updated VIF entry in instance network info cache for port e24dee70-e54f-4a1d-a4e7-3261e82b016b. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:26:08 user nova-compute[70645]: DEBUG nova.network.neutron [req-772a14fb-cd5d-41e5-ba5a-d3929395c729 req-bbd4e137-991c-4699-8a33-a8622693efa7 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Updating instance_info_cache with network_info: [{"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:26:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-772a14fb-cd5d-41e5-ba5a-d3929395c729 req-bbd4e137-991c-4699-8a33-a8622693efa7 service nova] Releasing lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212369.3185072, 01a8fe31-5b12-4c12-b567-80073fcc1d6a => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:26:09 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] VM Resumed (Lifecycle Event)
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:26:09 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Instance spawned successfully.
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:26:09 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212369.3198843, 01a8fe31-5b12-4c12-b567-80073fcc1d6a => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:26:09 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] VM Started (Lifecycle Event)
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:26:09 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:26:09 user nova-compute[70645]: INFO nova.compute.manager [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Took 5.07 seconds to spawn the instance on the hypervisor.
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:26:09 user nova-compute[70645]: INFO nova.compute.manager [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Took 12.06 seconds to build instance.
Jul 24 15:26:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9e9377f3-4ad9-4239-9298-2fd7f1754e61 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.243s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.compute.manager [req-c5e9b462-e6dd-467d-93d4-dd99fe6fd078 req-27c038fc-f30f-440d-97f5-cfe0760dfbf6 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Received event network-vif-plugged-a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c5e9b462-e6dd-467d-93d4-dd99fe6fd078 req-27c038fc-f30f-440d-97f5-cfe0760dfbf6 service nova] Acquiring lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c5e9b462-e6dd-467d-93d4-dd99fe6fd078 req-27c038fc-f30f-440d-97f5-cfe0760dfbf6 service nova] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c5e9b462-e6dd-467d-93d4-dd99fe6fd078 req-27c038fc-f30f-440d-97f5-cfe0760dfbf6 service nova] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:26:09 user nova-compute[70645]: DEBUG nova.compute.manager [req-c5e9b462-e6dd-467d-93d4-dd99fe6fd078 req-27c038fc-f30f-440d-97f5-cfe0760dfbf6 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] No waiting events found dispatching network-vif-plugged-a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:26:09 user nova-compute[70645]: WARNING nova.compute.manager [req-c5e9b462-e6dd-467d-93d4-dd99fe6fd078 req-27c038fc-f30f-440d-97f5-cfe0760dfbf6 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Received unexpected event network-vif-plugged-a2bb0354-0c14-4a8b-a819-160025fb1118 for instance with vm_state active and task_state None.
Jul 24 15:26:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:26:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:26:10 user nova-compute[70645]: DEBUG nova.objects.instance [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'flavor' on Instance uuid 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:26:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:26:11 user nova-compute[70645]: INFO nova.compute.manager [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Attaching volume a4df8b89-f8ff-4f31-9beb-d2416ac36593 to /dev/vdb
Jul 24 15:26:11 user nova-compute[70645]: DEBUG os_brick.utils [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b99e98-7e03-4541-94cc-d261da26e9e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b85f7db-726a-42cb-97c1-0039e6753da6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[32acf099-5000-4909-b47e-b1e2b117c4c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a4adb-e378-4ec9-81f3-279530f450a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:26:11 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:26:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[757c178e-99ed-457b-ab71-9a9d44f6da16]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG os_brick.utils [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:26:11 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Updating existing volume attachment record: a9a16532-bb18-4494-a454-d0bf9aabbc0e {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:26:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSxJjVZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:26:18 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:26:18 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:26:18 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec11c99-af3a-4213-860a-439f1d5c27e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:26:18 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[71300b7d-5f56-4dde-8354-e99af7b2840a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593] added
Jul 24 15:26:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1546f90-125c-471a-8664-038853b079ea]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[593a4826-17a6-4b0a-a6d7-e0064149a0da]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSxJjVZk {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSxJjVZk" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d23dd19-f0e7-4c6b-be6a-3effe4fc7156]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pSxJjVZk'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[818ff4fa-cdc1-4381-a02e-be9c064187e8]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8c82b0-fa9b-4543-aff6-9e9d4625162b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:26:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:26:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee20329-2cd9-4fef-a9a8-abb83b146e6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593, portal: 172.16.0.220,3260]
Jul 24 15:26:18 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593, portal: 172.16.0.220,3260] successful.
Jul 24 15:26:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae092dc-805c-4a4e-8fff-e321123c89d5]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c2d1f9-2a0a-4e7c-86f7-f7d5b275c9f0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:26:18 user nova-compute[70645]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 (non-flash)
Jul 24 15:26:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:26:18 user nova-compute[70645]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 (non-flash)
Jul 24 15:26:18 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5faa2c-fd76-4b8f-b3c4-9f3676ea52cc]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSxJjVZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:26:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:26:19 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23064356634316438', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:26:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064356634316438', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:26:19 user nova-compute[70645]: DEBUG nova.objects.instance [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'flavor' on Instance uuid 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:26:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:26:19 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:26:19 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:26:19 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:26:19 user nova-compute[70645]:   <serial>a4df8b89-f8ff-4f31-9beb-d2416ac36593</serial>
Jul 24 15:26:19 user nova-compute[70645]: </disk>
Jul 24 15:26:19 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:26:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:26:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:26:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] No VIF found with MAC fa:16:3e:f1:07:0c, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:26:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-e3deefec-85f2-4eaf-a932-a0449534bf7f tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.754s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:26:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:26:21 user nova-compute[70645]: INFO nova.compute.manager [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Detaching volume a4df8b89-f8ff-4f31-9beb-d2416ac36593
Jul 24 15:26:21 user nova-compute[70645]: INFO nova.virt.block_device [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Attempting to driver detach volume a4df8b89-f8ff-4f31-9beb-d2416ac36593 from mountpoint /dev/vdb
Jul 24 15:26:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Attempting to detach device vdb from instance 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:26:21 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:26:21 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:26:21 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:26:21 user nova-compute[70645]:   <serial>a4df8b89-f8ff-4f31-9beb-d2416ac36593</serial>
Jul 24 15:26:21 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:26:21 user nova-compute[70645]: </disk>
Jul 24 15:26:21 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:26:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully detached device vdb from instance 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 from the persistent domain config.
Jul 24 15:26:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:26:21 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:26:21 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:26:21 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:26:21 user nova-compute[70645]:   <serial>a4df8b89-f8ff-4f31-9beb-d2416ac36593</serial>
Jul 24 15:26:21 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:26:21 user nova-compute[70645]: </disk>
Jul 24 15:26:21 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690212381.6061072, 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:26:21 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully detached device vdb from instance 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 from the live domain config.
Jul 24 15:26:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSxJjVZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:26:21 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d61a9b-c7ba-42d5-aa4c-c6a79cc965e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b2261f-7f00-4db9-beba-b987aa368df4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:26:21 user nova-compute[70645]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 (non-flash)
Jul 24 15:26:21 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:26:21 user nova-compute[70645]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 (non-flash)
Jul 24 15:26:21 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba84571090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f707e71-955b-479e-a529-613eb3485d0b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d90cc2-d349-4b18-996f-46ccf0105a08]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[26020157-1826-472a-b69a-517cc6964215]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bd744c-2af3-4002-940c-f43b20694be5]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2a7bbd-ff7d-4225-ad2b-d97fb2b080c4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[21438a09-1c99-4b25-b6d8-20387be4c8e8]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593, portal: 172.16.0.220,3260]
Jul 24 15:26:21 user nova-compute[70645]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593, portal: 172.16.0.220,3260] successful.
Jul 24 15:26:21 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4df8b89-f8ff-4f31-9beb-d2416ac36593 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dd3eac-95a7-4ac2-b36d-3352127edf47]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] <== disconnect_volume: return (283ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:26:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:26:23 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'flavor' on Instance uuid 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:26:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c0e62f67-7da4-42fc-b962-66b60739b009 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.141s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:26:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:26:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:26:44 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:26:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:45 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:26:45 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:26:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:26:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:26:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:26:45 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:26:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:26:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:26:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:26:47 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:26:47 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:26:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8486MB free_disk=25.29338836669922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:26:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:26:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:26:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:26:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 38fd9832-4406-49fb-bd96-265c8e74740d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:26:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 01a8fe31-5b12-4c12-b567-80073fcc1d6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:26:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:26:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:26:47 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:26:47 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:26:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:26:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Updating instance_info_cache with network_info: [{"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:26:48 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:26:49 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:26:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:26:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:26:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:26:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:26:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:26:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:26:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:26:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:26:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:26:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:26:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:27:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:27:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:27:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:27:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:27:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:27:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:27:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:27:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:11 user nova-compute[70645]: INFO nova.compute.manager [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Terminating instance
Jul 24 15:27:11 user nova-compute[70645]: DEBUG nova.compute.manager [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG nova.compute.manager [req-210dfe73-c088-4c05-85dd-421c6a45e415 req-caae46b6-faa8-4ff3-9bbb-1b7be67a53b8 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Received event network-vif-unplugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-210dfe73-c088-4c05-85dd-421c6a45e415 req-caae46b6-faa8-4ff3-9bbb-1b7be67a53b8 service nova] Acquiring lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-210dfe73-c088-4c05-85dd-421c6a45e415 req-caae46b6-faa8-4ff3-9bbb-1b7be67a53b8 service nova] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-210dfe73-c088-4c05-85dd-421c6a45e415 req-caae46b6-faa8-4ff3-9bbb-1b7be67a53b8 service nova] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG nova.compute.manager [req-210dfe73-c088-4c05-85dd-421c6a45e415 req-caae46b6-faa8-4ff3-9bbb-1b7be67a53b8 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] No waiting events found dispatching network-vif-unplugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:27:11 user nova-compute[70645]: DEBUG nova.compute.manager [req-210dfe73-c088-4c05-85dd-421c6a45e415 req-caae46b6-faa8-4ff3-9bbb-1b7be67a53b8 service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Received event network-vif-unplugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Instance destroyed successfully.
Jul 24 15:27:12 user nova-compute[70645]: DEBUG nova.objects.instance [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lazy-loading 'resources' on Instance uuid 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-606022030',display_name='tempest-AttachVolumeNegativeTest-server-606022030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-606022030',id=47,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcnvXM/txPzODA1VBU8jz85Gv66/tdoOART+1ix8MOfoU/37QkWttIU6ZT6GPrh55uWfhgFEylNDIWil+13F6+/DrBfW8FVxad7od/Av2bxIRZgXVjOii93clavoUb/ng==',key_name='tempest-keypair-1101283843',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:24:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de7f4608ea8242fcbacfba6754da3628',ramdisk_id='',reservation_id='r-xmhbjiso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-508353659',owner_user_name='tempest-AttachVolumeNegativeTest-508353659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07525ed635a7407495f38c9556e7ce59',uuid=264d0360-0ecc-4dcb-ba4b-8ad37cceeed6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converting VIF {"id": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "address": "fa:16:3e:f1:07:0c", "network": {"id": "4328b995-335b-4f06-8270-697318151b26", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-854143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de7f4608ea8242fcbacfba6754da3628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24dee70-e5", "ovs_interfaceid": "e24dee70-e54f-4a1d-a4e7-3261e82b016b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:07:0c,bridge_name='br-int',has_traffic_filtering=True,id=e24dee70-e54f-4a1d-a4e7-3261e82b016b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape24dee70-e5') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG os_vif [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:07:0c,bridge_name='br-int',has_traffic_filtering=True,id=e24dee70-e54f-4a1d-a4e7-3261e82b016b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape24dee70-e5') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape24dee70-e5, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:12 user nova-compute[70645]: INFO os_vif [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:07:0c,bridge_name='br-int',has_traffic_filtering=True,id=e24dee70-e54f-4a1d-a4e7-3261e82b016b,network=Network(4328b995-335b-4f06-8270-697318151b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape24dee70-e5')
Jul 24 15:27:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Deleting instance files /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6_del
Jul 24 15:27:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Deletion of /opt/stack/data/nova/instances/264d0360-0ecc-4dcb-ba4b-8ad37cceeed6_del complete
Jul 24 15:27:12 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:12 user nova-compute[70645]: INFO nova.compute.manager [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 24 15:27:12 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:27:12 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:27:12 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Took 0.75 seconds to deallocate network for instance.
Jul 24 15:27:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:13 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:27:13 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:27:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:13 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Deleted allocations for instance 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6
Jul 24 15:27:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6838680a-f53b-49e3-a974-b75dc7944620 tempest-AttachVolumeNegativeTest-508353659 tempest-AttachVolumeNegativeTest-508353659-project-member] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:13 user nova-compute[70645]: DEBUG nova.compute.manager [req-637ee15f-d196-4259-ae45-8fd76e0b5f9b req-6308e478-9c57-4bb0-a8c1-4bce7c2fb48c service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Received event network-vif-plugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:27:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-637ee15f-d196-4259-ae45-8fd76e0b5f9b req-6308e478-9c57-4bb0-a8c1-4bce7c2fb48c service nova] Acquiring lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-637ee15f-d196-4259-ae45-8fd76e0b5f9b req-6308e478-9c57-4bb0-a8c1-4bce7c2fb48c service nova] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-637ee15f-d196-4259-ae45-8fd76e0b5f9b req-6308e478-9c57-4bb0-a8c1-4bce7c2fb48c service nova] Lock "264d0360-0ecc-4dcb-ba4b-8ad37cceeed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:13 user nova-compute[70645]: DEBUG nova.compute.manager [req-637ee15f-d196-4259-ae45-8fd76e0b5f9b req-6308e478-9c57-4bb0-a8c1-4bce7c2fb48c service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] No waiting events found dispatching network-vif-plugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:27:13 user nova-compute[70645]: WARNING nova.compute.manager [req-637ee15f-d196-4259-ae45-8fd76e0b5f9b req-6308e478-9c57-4bb0-a8c1-4bce7c2fb48c service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Received unexpected event network-vif-plugged-e24dee70-e54f-4a1d-a4e7-3261e82b016b for instance with vm_state deleted and task_state None.
Jul 24 15:27:13 user nova-compute[70645]: DEBUG nova.compute.manager [req-637ee15f-d196-4259-ae45-8fd76e0b5f9b req-6308e478-9c57-4bb0-a8c1-4bce7c2fb48c service nova] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Received event network-vif-deleted-e24dee70-e54f-4a1d-a4e7-3261e82b016b {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:27:17 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:22 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:27 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690212432.149408, 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:27:27 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] VM Stopped (Lifecycle Event)
Jul 24 15:27:27 user nova-compute[70645]: DEBUG nova.compute.manager [None req-b1aa4788-6d2d-4a5e-9c48-379c2ea3ecce None None] [instance: 264d0360-0ecc-4dcb-ba4b-8ad37cceeed6] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:27:27 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:27:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-d00664ce-04dc-4233-b8a4-a576ea6b6517 req-d3e28fe9-9caa-44bc-af92-2da5472523d1 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Received event network-changed-9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:27:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-d00664ce-04dc-4233-b8a4-a576ea6b6517 req-d3e28fe9-9caa-44bc-af92-2da5472523d1 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Refreshing instance network info cache due to event network-changed-9c82f167-a114-424c-ab4b-0b69db3724e3. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:27:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d00664ce-04dc-4233-b8a4-a576ea6b6517 req-d3e28fe9-9caa-44bc-af92-2da5472523d1 service nova] Acquiring lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:27:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d00664ce-04dc-4233-b8a4-a576ea6b6517 req-d3e28fe9-9caa-44bc-af92-2da5472523d1 service nova] Acquired lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:27:35 user nova-compute[70645]: DEBUG nova.network.neutron [req-d00664ce-04dc-4233-b8a4-a576ea6b6517 req-d3e28fe9-9caa-44bc-af92-2da5472523d1 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Refreshing network info cache for port 9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:27:36 user nova-compute[70645]: DEBUG nova.network.neutron [req-d00664ce-04dc-4233-b8a4-a576ea6b6517 req-d3e28fe9-9caa-44bc-af92-2da5472523d1 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updated VIF entry in instance network info cache for port 9c82f167-a114-424c-ab4b-0b69db3724e3. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:27:36 user nova-compute[70645]: DEBUG nova.network.neutron [req-d00664ce-04dc-4233-b8a4-a576ea6b6517 req-d3e28fe9-9caa-44bc-af92-2da5472523d1 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updating instance_info_cache with network_info: [{"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:27:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-d00664ce-04dc-4233-b8a4-a576ea6b6517 req-d3e28fe9-9caa-44bc-af92-2da5472523d1 service nova] Releasing lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:27:37 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:39 user nova-compute[70645]: INFO nova.compute.manager [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attaching volume 5ff9364e-4b30-4aff-81ce-d5bc99c9652b to /dev/vdb
Jul 24 15:27:39 user nova-compute[70645]: DEBUG os_brick.utils [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4e8222-381c-434d-8cdb-c22ee2191e2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd55773-648d-463a-a675-ec3a915c2e1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e0a592-9b11-425e-ae29-ad645c2174b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ef55f1-a49d-455c-86f8-cdcbfda9c925]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:27:39 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:27:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb83a747-69da-4ae9-9751-a929b004a8a2]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG os_brick.utils [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:27:39 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updating existing volume attachment record: 8e164e45-346f-4f1d-baa1-5aa7cc1d1696 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:27:42 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:44 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrVoiPFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:27:45 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:27:45 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:27:45 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5da8a02-e2e9-4e70-b9d6-7c47ceeb63c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:27:45 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5237145a-ac5e-4ef5-a9a0-ccff99a74b1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b] added
Jul 24 15:27:45 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62759cb-ed65-4e05-90b9-8e4061216289]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a3595-5dd5-4f21-949c-9e44b92a8b1e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrVoiPFR {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrVoiPFR" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f79e31-6b88-417b-b171-ce9324431ccc]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qrVoiPFR'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da2715a-724e-4f46-b921-aa439ffc69f2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef95ad-5a0f-4e1d-af98-602c9e044b97]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:27:45 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:27:45 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:27:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d0805a-f803-4b5e-bb61-d9bbac45a102]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b, portal: 172.16.0.220,3260]
Jul 24 15:27:46 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b, portal: 172.16.0.220,3260] successful.
Jul 24 15:27:46 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1a0968-eb98-4ba5-bc5d-260337736484]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6741dc13-4496-486d-9f1a-a1fa186bc7ef]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:27:46 user nova-compute[70645]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b (non-flash)
Jul 24 15:27:46 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:27:46 user nova-compute[70645]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b (non-flash)
Jul 24 15:27:46 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2419b073-7443-4124-a4dd-3b9ac192fb5b]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrVoiPFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:27:46 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:27:46 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:27:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=25.3201904296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 38fd9832-4406-49fb-bd96-265c8e74740d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 01a8fe31-5b12-4c12-b567-80073fcc1d6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:27:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:27:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23166616662663838', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:27:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166616662663838', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:27:47 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:27:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:27:47 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:27:47 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:27:47 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:27:47 user nova-compute[70645]:   <serial>5ff9364e-4b30-4aff-81ce-d5bc99c9652b</serial>
Jul 24 15:27:47 user nova-compute[70645]: </disk>
Jul 24 15:27:47 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:27:47 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:27:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:27:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No VIF found with MAC fa:16:3e:f4:e0:f4, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:27:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c7fe9e0b-b0b2-4b0a-a725-64b6bb95d38e tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.084s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:48 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:27:48 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:27:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updating instance_info_cache with network_info: [{"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-81d7a540-93a2-4b20-a0b5-14d7f94e8b37 req-999f328e-d055-4b9b-b36b-16d526c38f7b service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Received event network-changed-a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG nova.compute.manager [req-81d7a540-93a2-4b20-a0b5-14d7f94e8b37 req-999f328e-d055-4b9b-b36b-16d526c38f7b service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Refreshing instance network info cache due to event network-changed-a2bb0354-0c14-4a8b-a819-160025fb1118. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-81d7a540-93a2-4b20-a0b5-14d7f94e8b37 req-999f328e-d055-4b9b-b36b-16d526c38f7b service nova] Acquiring lock "refresh_cache-01a8fe31-5b12-4c12-b567-80073fcc1d6a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-81d7a540-93a2-4b20-a0b5-14d7f94e8b37 req-999f328e-d055-4b9b-b36b-16d526c38f7b service nova] Acquired lock "refresh_cache-01a8fe31-5b12-4c12-b567-80073fcc1d6a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG nova.network.neutron [req-81d7a540-93a2-4b20-a0b5-14d7f94e8b37 req-999f328e-d055-4b9b-b36b-16d526c38f7b service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Refreshing network info cache for port a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:27:49 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:50 user nova-compute[70645]: INFO nova.compute.manager [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Terminating instance
Jul 24 15:27:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-20577e25-a3a9-4289-a5c0-c7e2f8742674 req-61af52c4-78db-447d-8f31-890c2b8fbe9c service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Received event network-vif-unplugged-a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-20577e25-a3a9-4289-a5c0-c7e2f8742674 req-61af52c4-78db-447d-8f31-890c2b8fbe9c service nova] Acquiring lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-20577e25-a3a9-4289-a5c0-c7e2f8742674 req-61af52c4-78db-447d-8f31-890c2b8fbe9c service nova] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-20577e25-a3a9-4289-a5c0-c7e2f8742674 req-61af52c4-78db-447d-8f31-890c2b8fbe9c service nova] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-20577e25-a3a9-4289-a5c0-c7e2f8742674 req-61af52c4-78db-447d-8f31-890c2b8fbe9c service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] No waiting events found dispatching network-vif-unplugged-a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG nova.compute.manager [req-20577e25-a3a9-4289-a5c0-c7e2f8742674 req-61af52c4-78db-447d-8f31-890c2b8fbe9c service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Received event network-vif-unplugged-a2bb0354-0c14-4a8b-a819-160025fb1118 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-81d7a540-93a2-4b20-a0b5-14d7f94e8b37 req-999f328e-d055-4b9b-b36b-16d526c38f7b service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Updated VIF entry in instance network info cache for port a2bb0354-0c14-4a8b-a819-160025fb1118. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG nova.network.neutron [req-81d7a540-93a2-4b20-a0b5-14d7f94e8b37 req-999f328e-d055-4b9b-b36b-16d526c38f7b service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Updating instance_info_cache with network_info: [{"id": "a2bb0354-0c14-4a8b-a819-160025fb1118", "address": "fa:16:3e:c6:c1:75", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bb0354-0c", "ovs_interfaceid": "a2bb0354-0c14-4a8b-a819-160025fb1118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-81d7a540-93a2-4b20-a0b5-14d7f94e8b37 req-999f328e-d055-4b9b-b36b-16d526c38f7b service nova] Releasing lock "refresh_cache-01a8fe31-5b12-4c12-b567-80073fcc1d6a" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:27:50 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Instance destroyed successfully.
Jul 24 15:27:50 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'resources' on Instance uuid 01a8fe31-5b12-4c12-b567-80073fcc1d6a {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:25:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1893336493',display_name='tempest-TestVolumeBootPattern-server-1893336493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1893336493',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTRyGHkNM/F7Uj8s1zbBGzq4u2ODBAATzdNxRyu6wHhbmJaesfIAOHgecueCfWN8rF4+FlyT1hvCe5vW8Raq9odIyX9yY69korPYjadjkJh7/JFICKyDrIiyoOtLEuJfw==',key_name='tempest-TestVolumeBootPattern-364022229',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-nl7ahh04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:26:10Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=01a8fe31-5b12-4c12-b567-80073fcc1d6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2bb0354-0c14-4a8b-a819-160025fb1118", "address": "fa:16:3e:c6:c1:75", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bb0354-0c", "ovs_interfaceid": "a2bb0354-0c14-4a8b-a819-160025fb1118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "a2bb0354-0c14-4a8b-a819-160025fb1118", "address": "fa:16:3e:c6:c1:75", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bb0354-0c", "ovs_interfaceid": "a2bb0354-0c14-4a8b-a819-160025fb1118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c1:75,bridge_name='br-int',has_traffic_filtering=True,id=a2bb0354-0c14-4a8b-a819-160025fb1118,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bb0354-0c') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG os_vif [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c1:75,bridge_name='br-int',has_traffic_filtering=True,id=a2bb0354-0c14-4a8b-a819-160025fb1118,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bb0354-0c') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2bb0354-0c, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:27:50 user nova-compute[70645]: INFO os_vif [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c1:75,bridge_name='br-int',has_traffic_filtering=True,id=a2bb0354-0c14-4a8b-a819-160025fb1118,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bb0354-0c')
Jul 24 15:27:50 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwnvVkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:27:50 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:27:50 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:27:50 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d31117a-203b-4d10-a4af-c927ab969e07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d264e529-fa1e-4973-850f-009760a954ec]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:27:51 user nova-compute[70645]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b (non-flash)
Jul 24 15:27:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:27:51 user nova-compute[70645]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b (non-flash)
Jul 24 15:27:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba60697eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[426e1ba3-303f-4ec3-9759-b6caf80b4c36]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ba8725-a2a8-4fc0-a81c-55fd38c41bba]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4885e37d-50f9-4dfe-9665-9f0fa2f86d89]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1ae5fe-d179-40b2-bc47-36927079c23f]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4b2dfef-b893caa21c2f1dd8', '/dev/disk/by-id/scsi-26238393363616132', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4b2dfef') {{(pid=81509) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b5b98c-ea11-4933-aa90-6e6ab8126ec0]: (4, None) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c1895d-c83e-4479-b600-184271117d02]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3902f3-7780-4459-8c0f-0922972ad281]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260]
Jul 24 15:27:51 user nova-compute[70645]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260] successful.
Jul 24 15:27:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04856e4-8e4c-49b9-8a3d-505594795a46]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== disconnect_volume: return (274ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:27:51 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Deleting instance files /opt/stack/data/nova/instances/01a8fe31-5b12-4c12-b567-80073fcc1d6a_del
Jul 24 15:27:51 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Deletion of /opt/stack/data/nova/instances/01a8fe31-5b12-4c12-b567-80073fcc1d6a_del complete
Jul 24 15:27:51 user nova-compute[70645]: INFO nova.compute.manager [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 24 15:27:51 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:27:51 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:27:52 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:27:52 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Took 0.79 seconds to deallocate network for instance.
Jul 24 15:27:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-04a15cb2-224b-4e9a-b562-046098ff2fbe req-851197e0-4765-433f-8553-4cbf9fb07e31 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Received event network-vif-deleted-a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:27:52 user nova-compute[70645]: INFO nova.compute.manager [req-04a15cb2-224b-4e9a-b562-046098ff2fbe req-851197e0-4765-433f-8553-4cbf9fb07e31 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Neutron deleted interface a2bb0354-0c14-4a8b-a819-160025fb1118; detaching it from the instance and deleting it from the info cache
Jul 24 15:27:52 user nova-compute[70645]: DEBUG nova.network.neutron [req-04a15cb2-224b-4e9a-b562-046098ff2fbe req-851197e0-4765-433f-8553-4cbf9fb07e31 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:27:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-04a15cb2-224b-4e9a-b562-046098ff2fbe req-851197e0-4765-433f-8553-4cbf9fb07e31 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Detach interface failed, port_id=a2bb0354-0c14-4a8b-a819-160025fb1118, reason: Instance 01a8fe31-5b12-4c12-b567-80073fcc1d6a could not be found. {{(pid=70645) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 15:27:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-fd1c241f-b4d4-46da-a316-19eb62f8d1a4 req-f1fd4370-8e30-4aa0-bbc5-91d598ceef09 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Received event network-vif-plugged-a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:27:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd1c241f-b4d4-46da-a316-19eb62f8d1a4 req-f1fd4370-8e30-4aa0-bbc5-91d598ceef09 service nova] Acquiring lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd1c241f-b4d4-46da-a316-19eb62f8d1a4 req-f1fd4370-8e30-4aa0-bbc5-91d598ceef09 service nova] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-fd1c241f-b4d4-46da-a316-19eb62f8d1a4 req-f1fd4370-8e30-4aa0-bbc5-91d598ceef09 service nova] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:52 user nova-compute[70645]: DEBUG nova.compute.manager [req-fd1c241f-b4d4-46da-a316-19eb62f8d1a4 req-f1fd4370-8e30-4aa0-bbc5-91d598ceef09 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] No waiting events found dispatching network-vif-plugged-a2bb0354-0c14-4a8b-a819-160025fb1118 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:27:52 user nova-compute[70645]: WARNING nova.compute.manager [req-fd1c241f-b4d4-46da-a316-19eb62f8d1a4 req-f1fd4370-8e30-4aa0-bbc5-91d598ceef09 service nova] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Received unexpected event network-vif-plugged-a2bb0354-0c14-4a8b-a819-160025fb1118 for instance with vm_state active and task_state deleting.
Jul 24 15:27:52 user nova-compute[70645]: INFO nova.compute.manager [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Took 0.81 seconds to detach 1 volumes for instance.
Jul 24 15:27:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:27:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:27:53 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:27:53 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:27:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:53 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Deleted allocations for instance 01a8fe31-5b12-4c12-b567-80073fcc1d6a
Jul 24 15:27:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9afea860-cf24-4ce8-b065-81fe6415e2d3 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "01a8fe31-5b12-4c12-b567-80073fcc1d6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.066s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:27:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:27:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:02 user nova-compute[70645]: INFO nova.compute.manager [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Detaching volume 5ff9364e-4b30-4aff-81ce-d5bc99c9652b
Jul 24 15:28:02 user nova-compute[70645]: INFO nova.virt.block_device [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attempting to driver detach volume 5ff9364e-4b30-4aff-81ce-d5bc99c9652b from mountpoint /dev/vdb
Jul 24 15:28:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Attempting to detach device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:28:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:28:02 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:28:02 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:28:02 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:28:02 user nova-compute[70645]:   <serial>5ff9364e-4b30-4aff-81ce-d5bc99c9652b</serial>
Jul 24 15:28:02 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:28:02 user nova-compute[70645]: </disk>
Jul 24 15:28:02 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:28:02 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Successfully detached device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the persistent domain config.
Jul 24 15:28:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:28:02 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:28:02 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:28:02 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:28:02 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:28:02 user nova-compute[70645]:   <serial>5ff9364e-4b30-4aff-81ce-d5bc99c9652b</serial>
Jul 24 15:28:02 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:28:02 user nova-compute[70645]: </disk>
Jul 24 15:28:02 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690212483.265972, 38fd9832-4406-49fb-bd96-265c8e74740d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:28:03 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Successfully detached device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the live domain config.
Jul 24 15:28:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrVoiPFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:28:03 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bf9a50-2180-4689-90d1-6190095264f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8df9a4-cdd7-4bf6-9a3d-49ead38395f8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b (non-flash)
Jul 24 15:28:03 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b (non-flash)
Jul 24 15:28:03 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbaa1cc3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb976ec7-eada-4f6f-9068-dadb730fad9e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa280433-869a-45cf-bedd-127f4f120387]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23f5621-b293-4f3b-bd8f-f1995257ed6f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[852e502b-6940-48be-ae98-8174d3d8b92d]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bd4a11-e761-418b-89d4-a8f442f18043]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffb2a21-0356-4511-a512-6fb816361f02]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b, portal: 172.16.0.220,3260]
Jul 24 15:28:03 user nova-compute[70645]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b, portal: 172.16.0.220,3260] successful.
Jul 24 15:28:03 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff9364e-4b30-4aff-81ce-d5bc99c9652b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b78a78-7dac-4636-94e3-e7124c3e8417]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== disconnect_volume: return (281ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:28:03 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:28:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:28:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-48c1e151-8327-443f-ba3e-7de86a800b3c tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.616s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:28:05 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690212470.9547367, 01a8fe31-5b12-4c12-b567-80073fcc1d6a => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:28:05 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] VM Stopped (Lifecycle Event)
Jul 24 15:28:05 user nova-compute[70645]: DEBUG nova.compute.manager [None req-53e75dbb-4526-412c-ac48-bf86fc0c5546 None None] [instance: 01a8fe31-5b12-4c12-b567-80073fcc1d6a] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:28:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Verify base images {{(pid=70645) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Image id b4bccd44-68c1-4fe3-8a56-c3963153c7de yields fingerprint a9158b703961a7524219ee5bad1d130066a04e9b {{(pid=70645) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 24 15:28:09 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] image b4bccd44-68c1-4fe3-8a56-c3963153c7de at (/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b): checking
Jul 24 15:28:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] image b4bccd44-68c1-4fe3-8a56-c3963153c7de at (/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b): image is in use {{(pid=70645) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=70645) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] 38fd9832-4406-49fb-bd96-265c8e74740d is a valid instance name {{(pid=70645) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] 38fd9832-4406-49fb-bd96-265c8e74740d has a disk file {{(pid=70645) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 24 15:28:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:10 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 38fd9832-4406-49fb-bd96-265c8e74740d is backed by a9158b703961a7524219ee5bad1d130066a04e9b {{(pid=70645) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 24 15:28:10 user nova-compute[70645]: WARNING nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2
Jul 24 15:28:10 user nova-compute[70645]: WARNING nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Unknown base file: /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e
Jul 24 15:28:10 user nova-compute[70645]: WARNING nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d
Jul 24 15:28:10 user nova-compute[70645]: WARNING nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec
Jul 24 15:28:10 user nova-compute[70645]: WARNING nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7
Jul 24 15:28:10 user nova-compute[70645]: WARNING nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Unknown base file: /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4
Jul 24 15:28:10 user nova-compute[70645]: WARNING nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775
Jul 24 15:28:10 user nova-compute[70645]: WARNING nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb
Jul 24 15:28:10 user nova-compute[70645]: WARNING nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e
Jul 24 15:28:10 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Active base files: /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b
Jul 24 15:28:10 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Removable base files: /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2 /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7 /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4 /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775 /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e
Jul 24 15:28:10 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f641da8046782a4db0a3bca2f3711c16562a96c2
Jul 24 15:28:10 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/22a8ff649151c19c1cd129ff081975377d81863e
Jul 24 15:28:10 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f9641ff92f4c660b6ae9c2e637e50d03a612943d
Jul 24 15:28:10 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6e17d52da7e570382a885e36b1815f94afdd1dec
Jul 24 15:28:10 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9aee09626ab4f746e99b334cba913a3a2df66cf7
Jul 24 15:28:10 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/99f14164b57e0f43963836ef5fd64c6fceebc6b4
Jul 24 15:28:10 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4eeff0fb49e95ab2a8dfce04fcd27fe1ca9a3775
Jul 24 15:28:10 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0ed7924833608b7b0fbf24aecb9febbf8c170afb
Jul 24 15:28:10 user nova-compute[70645]: INFO nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cf46fe923edcbff325bca4864af4d0b13d79e65e
Jul 24 15:28:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Verification complete {{(pid=70645) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 24 15:28:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Verify swap images {{(pid=70645) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 24 15:28:10 user nova-compute[70645]: DEBUG nova.virt.libvirt.imagecache [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Verify ephemeral images {{(pid=70645) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 24 15:28:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:28:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:28:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:28:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:28:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:28:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:28:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:28:42 user nova-compute[70645]: INFO nova.compute.claims [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Claim successful on node user
Jul 24 15:28:42 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG nova.network.neutron [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:28:42 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:28:42 user nova-compute[70645]: DEBUG nova.compute.manager [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:28:42 user nova-compute[70645]: INFO nova.virt.block_device [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Booting with volume ac230bca-69f7-4820-9891-383465fbeaea at /dev/vda
Jul 24 15:28:42 user nova-compute[70645]: DEBUG os_brick.utils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG nova.policy [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a83e71e487ca401eb10e1d41d77b86fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92f320224c4b1e98b371f510a5e198', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6e7cb0-6a1d-45a9-9175-c0b046d7708b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81d67e1-8a85-46c6-a8d1-38fd4ae3ec73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[56706127-6a21-4ffa-8dbb-4190ebfd8c0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[037fe2b3-4a63-4310-a178-c5abd2aeea9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:28:42 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:28:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8631c607-e731-4440-9532-870bba397678]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG os_brick.utils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:28:42 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updating existing volume attachment record: e48e2e58-5e6e-4e91-afb7-854c7684e125 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:28:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Successfully created port: d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:28:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Successfully updated port: d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:28:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:28:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquired lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:28:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:28:44 user nova-compute[70645]: DEBUG nova.compute.manager [req-e19d63bb-ada4-493e-961c-6005e0dc25d8 req-e800c8cc-6ed4-4b91-a23c-a2f21db58103 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received event network-changed-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:28:44 user nova-compute[70645]: DEBUG nova.compute.manager [req-e19d63bb-ada4-493e-961c-6005e0dc25d8 req-e800c8cc-6ed4-4b91-a23c-a2f21db58103 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Refreshing instance network info cache due to event network-changed-d9dc06a2-46e6-4079-aa7e-858853df56ff. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:28:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e19d63bb-ada4-493e-961c-6005e0dc25d8 req-e800c8cc-6ed4-4b91-a23c-a2f21db58103 service nova] Acquiring lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:28:44 user nova-compute[70645]: DEBUG nova.network.neutron [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG nova.network.neutron [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updating instance_info_cache with network_info: [{"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Releasing lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG nova.compute.manager [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Instance network_info: |[{"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e19d63bb-ada4-493e-961c-6005e0dc25d8 req-e800c8cc-6ed4-4b91-a23c-a2f21db58103 service nova] Acquired lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-e19d63bb-ada4-493e-961c-6005e0dc25d8 req-e800c8cc-6ed4-4b91-a23c-a2f21db58103 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Refreshing network info cache for port d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-e19d63bb-ada4-493e-961c-6005e0dc25d8 req-e800c8cc-6ed4-4b91-a23c-a2f21db58103 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updated VIF entry in instance network info cache for port d9dc06a2-46e6-4079-aa7e-858853df56ff. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG nova.network.neutron [req-e19d63bb-ada4-493e-961c-6005e0dc25d8 req-e800c8cc-6ed4-4b91-a23c-a2f21db58103 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updating instance_info_cache with network_info: [{"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-e19d63bb-ada4-493e-961c-6005e0dc25d8 req-e800c8cc-6ed4-4b91-a23c-a2f21db58103 service nova] Releasing lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:28:45 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:46 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:28:46 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:28:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.308547973632812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 38fd9832-4406-49fb-bd96-265c8e74740d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:28:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:28:47 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:28:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:28:47 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:28:48 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:28:49 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:28:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:28:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 15:28:49 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:28:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:28:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:51 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:28:52 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:28:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 15:28:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] There are 0 instances to clean {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:28:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Creating image(s)
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Ensure instance console log exists: /opt/stack/data/nova/instances/815fdfff-2de8-4c7c-a4e5-8a470a8aea7c/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Start _get_guest_xml network_info=[{"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e48e2e58-5e6e-4e91-afb7-854c7684e125', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwnvVkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '815fdfff-2de8-4c7c-a4e5-8a470a8aea7c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac230bca-69f7-4820-9891-383465fbeaea', 'serial': 'ac230bca-69f7-4820-9891-383465fbeaea'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:28:53 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:28:53 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwnvVkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:28:53 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:28:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:28:53 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:28:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:28:53 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:28:53 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:28:53 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d8d960-3adb-455c-b634-3c92470b0d58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:28:54 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e8bf11-d15d-4988-8e65-f048afc42c95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea] added
Jul 24 15:28:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[581c2753-4fbc-4090-9112-4ddc2c075be7]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4dc72a-6198-48d0-9061-fb059f368232]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjwnvVkQ {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjwnvVkQ" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d461ec-58c0-4cc2-ad23-76663c1d4e78]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RjwnvVkQ'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27e888a-ec8a-4673-b949-1bcc21aa907a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f0a485-f5f7-499c-a2fb-32df0e5d9035]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:28:54 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:28:54 user nova-compute[70645]:  {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:28:54 user nova-compute[70645]: WARNING os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 15:28:54 user nova-compute[70645]: 
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acabbc0-45c0-4830-b35d-a8cce66784fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260]
Jul 24 15:28:54 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260] successful.
Jul 24 15:28:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e39adfa-71e8-4f3e-8f84-ce565b913350]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[19398e15-b3d9-4bb0-8979-4fe07f50fc83]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:28:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:28:54 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d976b9a2-b745-4a24-a9a8-06cb9cc465c5]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:28:54 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwnvVkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26238393363616132', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238393363616132', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-250526914',display_name='tempest-TestVolumeBootPattern-server-250526914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-250526914',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTRyGHkNM/F7Uj8s1zbBGzq4u2ODBAATzdNxRyu6wHhbmJaesfIAOHgecueCfWN8rF4+FlyT1hvCe5vW8Raq9odIyX9yY69korPYjadjkJh7/JFICKyDrIiyoOtLEuJfw==',key_name='tempest-TestVolumeBootPattern-364022229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-h82sufyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:28:43Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=815fdfff-2de8-4c7c-a4e5-8a470a8aea7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:99:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9dc06a2-46e6-4079-aa7e-858853df56ff,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc06a2-46') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.objects.instance [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'pci_devices' on Instance uuid 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:28:55 user nova-compute[70645]:   <uuid>815fdfff-2de8-4c7c-a4e5-8a470a8aea7c</uuid>
Jul 24 15:28:55 user nova-compute[70645]:   <name>instance-00000032</name>
Jul 24 15:28:55 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:28:55 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:28:55 user nova-compute[70645]:   <metadata>
Jul 24 15:28:55 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:28:55 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:28:55 user nova-compute[70645]:       <nova:name>tempest-TestVolumeBootPattern-server-250526914</nova:name>
Jul 24 15:28:55 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:28:53</nova:creationTime>
Jul 24 15:28:55 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:28:55 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:28:55 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:28:55 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:28:55 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:28:55 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:28:55 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:28:55 user nova-compute[70645]:       <nova:owner>
Jul 24 15:28:55 user nova-compute[70645]:         <nova:user uuid="a83e71e487ca401eb10e1d41d77b86fe">tempest-TestVolumeBootPattern-1424700934-project-member</nova:user>
Jul 24 15:28:55 user nova-compute[70645]:         <nova:project uuid="6f92f320224c4b1e98b371f510a5e198">tempest-TestVolumeBootPattern-1424700934</nova:project>
Jul 24 15:28:55 user nova-compute[70645]:       </nova:owner>
Jul 24 15:28:55 user nova-compute[70645]:       <nova:ports>
Jul 24 15:28:55 user nova-compute[70645]:         <nova:port uuid="d9dc06a2-46e6-4079-aa7e-858853df56ff">
Jul 24 15:28:55 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 15:28:55 user nova-compute[70645]:         </nova:port>
Jul 24 15:28:55 user nova-compute[70645]:       </nova:ports>
Jul 24 15:28:55 user nova-compute[70645]:     </nova:instance>
Jul 24 15:28:55 user nova-compute[70645]:   </metadata>
Jul 24 15:28:55 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:28:55 user nova-compute[70645]:     <system>
Jul 24 15:28:55 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:28:55 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:28:55 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:28:55 user nova-compute[70645]:       <entry name="serial">815fdfff-2de8-4c7c-a4e5-8a470a8aea7c</entry>
Jul 24 15:28:55 user nova-compute[70645]:       <entry name="uuid">815fdfff-2de8-4c7c-a4e5-8a470a8aea7c</entry>
Jul 24 15:28:55 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:28:55 user nova-compute[70645]:     </system>
Jul 24 15:28:55 user nova-compute[70645]:   </sysinfo>
Jul 24 15:28:55 user nova-compute[70645]:   <os>
Jul 24 15:28:55 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:28:55 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:28:55 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:28:55 user nova-compute[70645]:   </os>
Jul 24 15:28:55 user nova-compute[70645]:   <features>
Jul 24 15:28:55 user nova-compute[70645]:     <acpi/>
Jul 24 15:28:55 user nova-compute[70645]:     <apic/>
Jul 24 15:28:55 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:28:55 user nova-compute[70645]:   </features>
Jul 24 15:28:55 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:28:55 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:28:55 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:28:55 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:28:55 user nova-compute[70645]:   </clock>
Jul 24 15:28:55 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:28:55 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:28:55 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:28:55 user nova-compute[70645]:   </cpu>
Jul 24 15:28:55 user nova-compute[70645]:   <devices>
Jul 24 15:28:55 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:28:55 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:28:55 user nova-compute[70645]:       <source dev="/dev/sdb"/>
Jul 24 15:28:55 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:28:55 user nova-compute[70645]:       <serial>ac230bca-69f7-4820-9891-383465fbeaea</serial>
Jul 24 15:28:55 user nova-compute[70645]:     </disk>
Jul 24 15:28:55 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:28:55 user nova-compute[70645]:       <mac address="fa:16:3e:ad:99:7f"/>
Jul 24 15:28:55 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:28:55 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:28:55 user nova-compute[70645]:       <target dev="tapd9dc06a2-46"/>
Jul 24 15:28:55 user nova-compute[70645]:     </interface>
Jul 24 15:28:55 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:28:55 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/815fdfff-2de8-4c7c-a4e5-8a470a8aea7c/console.log" append="off"/>
Jul 24 15:28:55 user nova-compute[70645]:     </serial>
Jul 24 15:28:55 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:28:55 user nova-compute[70645]:     <video>
Jul 24 15:28:55 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:28:55 user nova-compute[70645]:     </video>
Jul 24 15:28:55 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:28:55 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:28:55 user nova-compute[70645]:     </rng>
Jul 24 15:28:55 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:28:55 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:28:55 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:28:55 user nova-compute[70645]:     </memballoon>
Jul 24 15:28:55 user nova-compute[70645]:   </devices>
Jul 24 15:28:55 user nova-compute[70645]: </domain>
Jul 24 15:28:55 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-250526914',display_name='tempest-TestVolumeBootPattern-server-250526914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-250526914',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTRyGHkNM/F7Uj8s1zbBGzq4u2ODBAATzdNxRyu6wHhbmJaesfIAOHgecueCfWN8rF4+FlyT1hvCe5vW8Raq9odIyX9yY69korPYjadjkJh7/JFICKyDrIiyoOtLEuJfw==',key_name='tempest-TestVolumeBootPattern-364022229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-h82sufyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:28:43Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=815fdfff-2de8-4c7c-a4e5-8a470a8aea7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:99:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9dc06a2-46e6-4079-aa7e-858853df56ff,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc06a2-46') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG os_vif [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:99:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9dc06a2-46e6-4079-aa7e-858853df56ff,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc06a2-46') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9dc06a2-46, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9dc06a2-46, col_values=(('external_ids', {'iface-id': 'd9dc06a2-46e6-4079-aa7e-858853df56ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:99:7f', 'vm-uuid': '815fdfff-2de8-4c7c-a4e5-8a470a8aea7c'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:55 user nova-compute[70645]: INFO os_vif [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:99:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9dc06a2-46e6-4079-aa7e-858853df56ff,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc06a2-46')
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No VIF found with MAC fa:16:3e:ad:99:7f, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG nova.objects.instance [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:55 user nova-compute[70645]: INFO nova.compute.manager [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attaching volume 63f248ec-a9de-49a4-8f47-1bf34800f24f to /dev/vdb
Jul 24 15:28:55 user nova-compute[70645]: DEBUG os_brick.utils [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:28:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[315997e1-1423-4951-a657-51614150cdb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b857640-42ea-4445-9c53-be876f2a565f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a990e421-7bc3-4292-b092-86ac4f30f77a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1cd12f-3c3e-400f-9326-400f57d3749d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:28:56 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c85c78-fea4-4baf-9616-f034b58f7beb]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG os_brick.utils [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updating existing volume attachment record: f194b927-90c2-4a29-9e24-8aee338f899f {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG nova.compute.manager [req-1f690e09-15f0-4b03-a94b-f433e4480831 req-23de1024-eaf1-4104-9132-af59bcde7adb service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received event network-vif-plugged-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1f690e09-15f0-4b03-a94b-f433e4480831 req-23de1024-eaf1-4104-9132-af59bcde7adb service nova] Acquiring lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1f690e09-15f0-4b03-a94b-f433e4480831 req-23de1024-eaf1-4104-9132-af59bcde7adb service nova] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-1f690e09-15f0-4b03-a94b-f433e4480831 req-23de1024-eaf1-4104-9132-af59bcde7adb service nova] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:28:56 user nova-compute[70645]: DEBUG nova.compute.manager [req-1f690e09-15f0-4b03-a94b-f433e4480831 req-23de1024-eaf1-4104-9132-af59bcde7adb service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] No waiting events found dispatching network-vif-plugged-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:28:56 user nova-compute[70645]: WARNING nova.compute.manager [req-1f690e09-15f0-4b03-a94b-f433e4480831 req-23de1024-eaf1-4104-9132-af59bcde7adb service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received unexpected event network-vif-plugged-d9dc06a2-46e6-4079-aa7e-858853df56ff for instance with vm_state building and task_state spawning.
Jul 24 15:28:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212538.7681136, 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:28:58 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] VM Resumed (Lifecycle Event)
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:28:58 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Instance spawned successfully.
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:28:58 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212538.7696197, 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:28:58 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] VM Started (Lifecycle Event)
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:28:58 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:28:58 user nova-compute[70645]: INFO nova.compute.manager [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Took 4.98 seconds to spawn the instance on the hypervisor.
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.compute.manager [req-0f4a0c6c-79be-438d-8ff2-8fe10aeac8e3 req-97676ef2-05e6-4e50-9b96-fe41119ee844 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received event network-vif-plugged-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0f4a0c6c-79be-438d-8ff2-8fe10aeac8e3 req-97676ef2-05e6-4e50-9b96-fe41119ee844 service nova] Acquiring lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0f4a0c6c-79be-438d-8ff2-8fe10aeac8e3 req-97676ef2-05e6-4e50-9b96-fe41119ee844 service nova] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-0f4a0c6c-79be-438d-8ff2-8fe10aeac8e3 req-97676ef2-05e6-4e50-9b96-fe41119ee844 service nova] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:28:58 user nova-compute[70645]: DEBUG nova.compute.manager [req-0f4a0c6c-79be-438d-8ff2-8fe10aeac8e3 req-97676ef2-05e6-4e50-9b96-fe41119ee844 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] No waiting events found dispatching network-vif-plugged-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:28:58 user nova-compute[70645]: WARNING nova.compute.manager [req-0f4a0c6c-79be-438d-8ff2-8fe10aeac8e3 req-97676ef2-05e6-4e50-9b96-fe41119ee844 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received unexpected event network-vif-plugged-d9dc06a2-46e6-4079-aa7e-858853df56ff for instance with vm_state building and task_state spawning.
Jul 24 15:28:58 user nova-compute[70645]: INFO nova.compute.manager [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Took 16.74 seconds to build instance.
Jul 24 15:28:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-394649f4-11aa-4a5c-967b-91db9a1100e0 tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.837s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:28:59 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:04 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIkYLlBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:29:07 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:29:07 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:29:07 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc76415-be16-43fe-844c-8c27032730f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:29:07 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deb2a7b-559d-4896-9110-6df69c5fe91e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f] added
Jul 24 15:29:07 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33aa508-a0d9-4187-a25b-aa8ba2c82a7b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0057727-2ef4-4bdc-a503-44bcd2cc30fd]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIkYLlBG {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIkYLlBG" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4428ce-a9a5-4d8f-a859-5f4a7c657833]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UIkYLlBG'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[011e3a14-f31c-41a2-8bd9-66be2a696df2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[149629e1-5b93-432d-81d1-03004a4f128d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:29:07 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:29:07 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:29:07 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bdc087-9beb-4d15-9394-6d09c53666e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f, portal: 172.16.0.220,3260]
Jul 24 15:29:08 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f, portal: 172.16.0.220,3260] successful.
Jul 24 15:29:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c3fc2f-3c84-4790-8863-4af76803328b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c52360-2e16-46d1-8775-0af2db18a50a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:29:08 user nova-compute[70645]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f (non-flash)
Jul 24 15:29:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:29:08 user nova-compute[70645]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f (non-flash)
Jul 24 15:29:08 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7165964-bb93-4cf7-80f7-97fc1cfae664]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:29:08 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIkYLlBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:29:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:29:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23735613036343664', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:29:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735613036343664', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:29:09 user nova-compute[70645]: DEBUG nova.objects.instance [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:29:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:29:09 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:29:09 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:29:09 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:29:09 user nova-compute[70645]:   <serial>63f248ec-a9de-49a4-8f47-1bf34800f24f</serial>
Jul 24 15:29:09 user nova-compute[70645]: </disk>
Jul 24 15:29:09 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:29:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:29:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:29:09 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No VIF found with MAC fa:16:3e:f4:e0:f4, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:29:09 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-6e3dd0c2-4e4d-4bf1-adb6-3b8479dc0bc0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.748s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:29:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:29:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:29:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:29:11 user nova-compute[70645]: INFO nova.compute.manager [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Detaching volume 63f248ec-a9de-49a4-8f47-1bf34800f24f
Jul 24 15:29:11 user nova-compute[70645]: INFO nova.virt.block_device [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attempting to driver detach volume 63f248ec-a9de-49a4-8f47-1bf34800f24f from mountpoint /dev/vdb
Jul 24 15:29:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Attempting to detach device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:29:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:29:11 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:29:11 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:29:11 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:29:11 user nova-compute[70645]:   <serial>63f248ec-a9de-49a4-8f47-1bf34800f24f</serial>
Jul 24 15:29:11 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:29:11 user nova-compute[70645]: </disk>
Jul 24 15:29:11 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:29:11 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Successfully detached device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the persistent domain config.
Jul 24 15:29:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:29:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:29:11 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:29:11 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:29:11 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:29:11 user nova-compute[70645]:   <serial>63f248ec-a9de-49a4-8f47-1bf34800f24f</serial>
Jul 24 15:29:11 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:29:11 user nova-compute[70645]: </disk>
Jul 24 15:29:11 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690212552.019486, 38fd9832-4406-49fb-bd96-265c8e74740d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:29:12 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Successfully detached device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the live domain config.
Jul 24 15:29:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIkYLlBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:29:12 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c619fe-4ec7-4e14-9d70-29ab2e1b2b62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dd2de0-9cee-4567-900f-639d51c4c472]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:29:12 user nova-compute[70645]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f (non-flash)
Jul 24 15:29:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:29:12 user nova-compute[70645]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f (non-flash)
Jul 24 15:29:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbaa1cc1510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4a833e-4f1c-4068-85e8-939a372de183]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a51c658-a5fc-4bea-ad21-e642dd1d4817]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4be659c-be63-4df7-9ee8-25c808e15ef3]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d32635-d938-4a8e-98b1-5e550e832c6b]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8213af0a-c027-413c-b6b7-bbcaf3ecc560]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c5e155-e748-49d1-b3e6-c92972562a53]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f, portal: 172.16.0.220,3260]
Jul 24 15:29:12 user nova-compute[70645]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f, portal: 172.16.0.220,3260] successful.
Jul 24 15:29:12 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f248ec-a9de-49a4-8f47-1bf34800f24f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82cba22-2b29-4096-a67f-1752cb7dbda1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== disconnect_volume: return (263ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:29:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:29:13 user nova-compute[70645]: DEBUG nova.objects.instance [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:29:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-38e244bd-ebdf-4a04-a12d-95f4813b05c0 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.765s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:29:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:20 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70645) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 15:29:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:29:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:29:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:29:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:29:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:29:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:29:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:29:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:29:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:29:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:29:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:29:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:29:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:29:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:29:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:29:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:29:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:29:47 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:29:47 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:29:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8702MB free_disk=25.30542755126953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:29:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:29:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:29:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 38fd9832-4406-49fb-bd96-265c8e74740d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:29:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:29:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:29:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:29:48 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing inventories for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 15:29:48 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Updating ProviderTree inventory for provider a0cf5b80-69d2-4191-894e-a498eab7d688 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 15:29:48 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 15:29:48 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing aggregate associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, aggregates: None {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 15:29:48 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing trait associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 15:29:48 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:29:48 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:29:48 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:29:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:29:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:50 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:29:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:51 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:29:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:29:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:29:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:29:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:29:52 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:29:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updating instance_info_cache with network_info: [{"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:29:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:29:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:29:52 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:52 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:29:55 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:30:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:30:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:30:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:30:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:30:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:30:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:30:04 user nova-compute[70645]: INFO nova.compute.manager [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attaching volume e0231964-128e-4b06-8779-cb6d35afc645 to /dev/vdb
Jul 24 15:30:05 user nova-compute[70645]: DEBUG os_brick.utils [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[58023670-a38f-4fd2-b5de-9fe7172adefa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f31c99-8b6b-4db6-998d-69f2ded74a10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea138c3-f124-45bd-914b-77d1f164e876]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[380c7781-f16c-47e8-8bf0-23e1706d0285]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:30:05 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:30:05 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2baf483-cbde-4d29-b8ba-5410706023a2]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG os_brick.utils [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updating existing volume attachment record: 175b7ea2-7fc5-4032-b6e9-4c0697b27758 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:30:05 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:30:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:10 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdzlMcrn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:30:11 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:30:11 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:30:11 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[17da6495-7c3b-44e8-9890-2191f861de42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:30:11 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[961fc74b-d268-447c-8ba2-68805b4b2fc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645] added
Jul 24 15:30:11 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e8af71-479a-4b7c-9fcb-f73a6d35de5d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dcc257-4c22-408e-a159-56dc2bf41f5f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdzlMcrn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdzlMcrn" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3fc412-edbc-4875-81ea-fc3430a5ab8d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FdzlMcrn'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[da95ad31-596d-4170-a60d-68884498b7c3]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8581a5dd-d16c-4988-949a-eea131f830c4]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:30:11 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:30:11 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3696a3d0-c6f8-49a3-a08a-6986d72ad666]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645, portal: 172.16.0.220,3260]
Jul 24 15:30:11 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645, portal: 172.16.0.220,3260] successful.
Jul 24 15:30:11 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c6064-8e82-4439-88b5-b7fc290b64b4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[771c0d02-ef17-4226-bbe6-a1e435d44ae1]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:30:11 user nova-compute[70645]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 (non-flash)
Jul 24 15:30:11 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:30:11 user nova-compute[70645]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 (non-flash)
Jul 24 15:30:11 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ce12b0-604f-49e2-86f5-6e69b8c1f6dc]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:30:11 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdzlMcrn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:30:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:30:12 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26265373230326330', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:30:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265373230326330', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:30:12 user nova-compute[70645]: DEBUG nova.objects.instance [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:30:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:30:12 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:30:12 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:30:12 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:30:12 user nova-compute[70645]:   <serial>e0231964-128e-4b06-8779-cb6d35afc645</serial>
Jul 24 15:30:12 user nova-compute[70645]: </disk>
Jul 24 15:30:12 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:30:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:30:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:30:12 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No VIF found with MAC fa:16:3e:f4:e0:f4, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:30:13 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-1949eb7f-49b6-4cd2-af2b-b88fef6a9792 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.093s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:30:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:30:15 user nova-compute[70645]: INFO nova.compute.manager [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Detaching volume e0231964-128e-4b06-8779-cb6d35afc645
Jul 24 15:30:15 user nova-compute[70645]: INFO nova.virt.block_device [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attempting to driver detach volume e0231964-128e-4b06-8779-cb6d35afc645 from mountpoint /dev/vdb
Jul 24 15:30:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Attempting to detach device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:30:15 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:30:15 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:30:15 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:30:15 user nova-compute[70645]:   <serial>e0231964-128e-4b06-8779-cb6d35afc645</serial>
Jul 24 15:30:15 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:30:15 user nova-compute[70645]: </disk>
Jul 24 15:30:15 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:30:15 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Successfully detached device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the persistent domain config.
Jul 24 15:30:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:30:15 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:30:15 user nova-compute[70645]:   <source dev="/dev/sdc"/>
Jul 24 15:30:15 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:30:15 user nova-compute[70645]:   <serial>e0231964-128e-4b06-8779-cb6d35afc645</serial>
Jul 24 15:30:15 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:30:15 user nova-compute[70645]: </disk>
Jul 24 15:30:15 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690212615.5466602, 38fd9832-4406-49fb-bd96-265c8e74740d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:30:15 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Successfully detached device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the live domain config.
Jul 24 15:30:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdzlMcrn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:30:15 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3835e0a4-9295-42ad-9324-3169859c3b6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a19c8d0-7d65-4b4b-89a0-9c8ea565606e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:30:15 user nova-compute[70645]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 (non-flash)
Jul 24 15:30:15 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:30:15 user nova-compute[70645]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 (non-flash)
Jul 24 15:30:15 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba60697c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3fbaf3-ace0-4b5e-ba67-ca1f59704f90]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[849c66b2-c96d-4476-b259-cf62ac4dd5af]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee0d6dc-5282-4b62-9d30-f62bcd299da1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7053c6b6-cce2-4a4c-b342-d4c735f9c9f6]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe73e48-15e2-4fab-8f3c-3a63a34c064d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[11559854-2438-4937-aaeb-e08073869fe3]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645, portal: 172.16.0.220,3260]
Jul 24 15:30:15 user nova-compute[70645]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645, portal: 172.16.0.220,3260] successful.
Jul 24 15:30:15 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0231964-128e-4b06-8779-cb6d35afc645 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e1e3d8-9fea-4f9f-9680-95d87f34cc33]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== disconnect_volume: return (274ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:30:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:30:16 user nova-compute[70645]: DEBUG nova.objects.instance [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:30:16 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-4561b215-3968-4c0f-88ee-9be8f1229c14 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.575s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:30:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:20 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:30:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:30:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:30:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:30:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:30:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-feedd433-22ae-4fea-b553-556c3e5dffb1 req-4681486b-6385-4eac-8a4d-a852f78464e5 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received event network-changed-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:30:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-feedd433-22ae-4fea-b553-556c3e5dffb1 req-4681486b-6385-4eac-8a4d-a852f78464e5 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Refreshing instance network info cache due to event network-changed-d9dc06a2-46e6-4079-aa7e-858853df56ff. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:30:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-feedd433-22ae-4fea-b553-556c3e5dffb1 req-4681486b-6385-4eac-8a4d-a852f78464e5 service nova] Acquiring lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:30:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-feedd433-22ae-4fea-b553-556c3e5dffb1 req-4681486b-6385-4eac-8a4d-a852f78464e5 service nova] Acquired lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:30:33 user nova-compute[70645]: DEBUG nova.network.neutron [req-feedd433-22ae-4fea-b553-556c3e5dffb1 req-4681486b-6385-4eac-8a4d-a852f78464e5 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Refreshing network info cache for port d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:30:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-feedd433-22ae-4fea-b553-556c3e5dffb1 req-4681486b-6385-4eac-8a4d-a852f78464e5 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updated VIF entry in instance network info cache for port d9dc06a2-46e6-4079-aa7e-858853df56ff. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:30:34 user nova-compute[70645]: DEBUG nova.network.neutron [req-feedd433-22ae-4fea-b553-556c3e5dffb1 req-4681486b-6385-4eac-8a4d-a852f78464e5 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updating instance_info_cache with network_info: [{"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:30:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-feedd433-22ae-4fea-b553-556c3e5dffb1 req-4681486b-6385-4eac-8a4d-a852f78464e5 service nova] Releasing lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:30:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:40 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "8e71b884-58cb-415e-b3ef-221810e346ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:30:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "8e71b884-58cb-415e-b3ef-221810e346ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:30:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:30:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:30:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:30:41 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:30:41 user nova-compute[70645]: INFO nova.compute.claims [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Claim successful on node user
Jul 24 15:30:41 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:30:41 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:30:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:30:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:30:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:30:41 user nova-compute[70645]: DEBUG nova.network.neutron [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:30:41 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:30:41 user nova-compute[70645]: DEBUG nova.compute.manager [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:30:41 user nova-compute[70645]: INFO nova.virt.block_device [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Booting with volume 80677624-c170-48ec-bb40-9676dd3b2430 at /dev/vda
Jul 24 15:30:41 user nova-compute[70645]: DEBUG nova.policy [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a83e71e487ca401eb10e1d41d77b86fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92f320224c4b1e98b371f510a5e198', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG os_brick.utils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdd27b8-d31b-4720-aee7-507f031f329a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[88be1116-f1df-4dde-bde4-3f1163d185f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef323572-c4b8-4514-8468-ab58127c00c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8a4c8a-c799-4605-8ae6-d9be4d0b5986]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:30:42 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:30:42 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e97db-70e0-4da0-b016-369a20c822dc]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG os_brick.utils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Updating existing volume attachment record: 9aded266-c8f0-487b-9448-06fee2e6711c {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:30:42 user nova-compute[70645]: DEBUG nova.network.neutron [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Successfully created port: e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Successfully updated port: e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquired lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-05d53742-3f0f-42ea-9bc6-4704d476ed2b req-19df5839-e9ca-45af-85cc-11a7019de54f service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received event network-changed-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG nova.compute.manager [req-05d53742-3f0f-42ea-9bc6-4704d476ed2b req-19df5839-e9ca-45af-85cc-11a7019de54f service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Refreshing instance network info cache due to event network-changed-e0723d23-d758-42d3-bb04-f38c658b250c. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-05d53742-3f0f-42ea-9bc6-4704d476ed2b req-19df5839-e9ca-45af-85cc-11a7019de54f service nova] Acquiring lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG nova.network.neutron [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Updating instance_info_cache with network_info: [{"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Releasing lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG nova.compute.manager [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Instance network_info: |[{"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-05d53742-3f0f-42ea-9bc6-4704d476ed2b req-19df5839-e9ca-45af-85cc-11a7019de54f service nova] Acquired lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:30:43 user nova-compute[70645]: DEBUG nova.network.neutron [req-05d53742-3f0f-42ea-9bc6-4704d476ed2b req-19df5839-e9ca-45af-85cc-11a7019de54f service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Refreshing network info cache for port e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:30:44 user nova-compute[70645]: DEBUG nova.network.neutron [req-05d53742-3f0f-42ea-9bc6-4704d476ed2b req-19df5839-e9ca-45af-85cc-11a7019de54f service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Updated VIF entry in instance network info cache for port e0723d23-d758-42d3-bb04-f38c658b250c. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:30:44 user nova-compute[70645]: DEBUG nova.network.neutron [req-05d53742-3f0f-42ea-9bc6-4704d476ed2b req-19df5839-e9ca-45af-85cc-11a7019de54f service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Updating instance_info_cache with network_info: [{"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:30:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-05d53742-3f0f-42ea-9bc6-4704d476ed2b req-19df5839-e9ca-45af-85cc-11a7019de54f service nova] Releasing lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:30:45 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:30:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:30:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:30:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:30:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:30:46 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:30:46 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:30:47 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:30:47 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:30:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=25.303794860839844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 38fd9832-4406-49fb-bd96-265c8e74740d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 8e71b884-58cb-415e-b3ef-221810e346ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:30:47 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:30:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Creating image(s)
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Did not create local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Ensure instance console log exists: /opt/stack/data/nova/instances/8e71b884-58cb-415e-b3ef-221810e346ea/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Start _get_guest_xml network_info=[{"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9aded266-c8f0-487b-9448-06fee2e6711c', 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVdSBiPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e71b884-58cb-415e-b3ef-221810e346ea', 'attached_at': '', 'detached_at': '', 'volume_id': '80677624-c170-48ec-bb40-9676dd3b2430', 'serial': '80677624-c170-48ec-bb40-9676dd3b2430'}, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:30:48 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:30:48 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVdSBiPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:30:48 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:30:48 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:30:48 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3065143-c516-4132-99cb-0a9e252da505]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:30:48 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec303c4-6b3f-4f49-b176-676286db7951]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430] added
Jul 24 15:30:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a6395d-6ca0-4ded-817b-71a7d0dd351d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[410a69fe-7e46-4c20-84f2-07d6adea5dfa]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVdSBiPr {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVdSBiPr" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e398b3f-43f2-41ab-bae5-74aefb4357bf]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pVdSBiPr'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f417b2-ce07-4772-824c-3e8fc324115b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96794f4-20d8-4de9-9284-f6293ad3f9f0]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:30:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:30:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c9514d-527d-42b3-a73b-ff6c078aa880]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430, portal: 172.16.0.220,3260]
Jul 24 15:30:48 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430, portal: 172.16.0.220,3260] successful.
Jul 24 15:30:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c79337c-1f39-4b8e-967f-0a084e6eb79b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff054acd-d43f-4433-9b16-75ed7b31d89e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:30:48 user nova-compute[70645]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)
Jul 24 15:30:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:30:48 user nova-compute[70645]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)
Jul 24 15:30:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7980b0c-84a4-496d-94e2-bcd828c2c429]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:30:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVdSBiPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26561623535316639', 'path': '/dev/sdc'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561623535316639', 'path': '/dev/sdc'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-948206049',display_name='tempest-TestVolumeBootPattern-server-948206049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-948206049',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTRyGHkNM/F7Uj8s1zbBGzq4u2ODBAATzdNxRyu6wHhbmJaesfIAOHgecueCfWN8rF4+FlyT1hvCe5vW8Raq9odIyX9yY69korPYjadjkJh7/JFICKyDrIiyoOtLEuJfw==',key_name='tempest-TestVolumeBootPattern-364022229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-edt78d10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:30:42Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=8e71b884-58cb-415e-b3ef-221810e346ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:78:c1,bridge_name='br-int',has_traffic_filtering=True,id=e0723d23-d758-42d3-bb04-f38c658b250c,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0723d23-d7') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG nova.objects.instance [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e71b884-58cb-415e-b3ef-221810e346ea {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:30:49 user nova-compute[70645]:   <uuid>8e71b884-58cb-415e-b3ef-221810e346ea</uuid>
Jul 24 15:30:49 user nova-compute[70645]:   <name>instance-00000033</name>
Jul 24 15:30:49 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:30:49 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:30:49 user nova-compute[70645]:   <metadata>
Jul 24 15:30:49 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:30:49 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:30:49 user nova-compute[70645]:       <nova:name>tempest-TestVolumeBootPattern-server-948206049</nova:name>
Jul 24 15:30:49 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:30:48</nova:creationTime>
Jul 24 15:30:49 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:30:49 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:30:49 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:30:49 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:30:49 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:30:49 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:30:49 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:30:49 user nova-compute[70645]:       <nova:owner>
Jul 24 15:30:49 user nova-compute[70645]:         <nova:user uuid="a83e71e487ca401eb10e1d41d77b86fe">tempest-TestVolumeBootPattern-1424700934-project-member</nova:user>
Jul 24 15:30:49 user nova-compute[70645]:         <nova:project uuid="6f92f320224c4b1e98b371f510a5e198">tempest-TestVolumeBootPattern-1424700934</nova:project>
Jul 24 15:30:49 user nova-compute[70645]:       </nova:owner>
Jul 24 15:30:49 user nova-compute[70645]:       <nova:ports>
Jul 24 15:30:49 user nova-compute[70645]:         <nova:port uuid="e0723d23-d758-42d3-bb04-f38c658b250c">
Jul 24 15:30:49 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 15:30:49 user nova-compute[70645]:         </nova:port>
Jul 24 15:30:49 user nova-compute[70645]:       </nova:ports>
Jul 24 15:30:49 user nova-compute[70645]:     </nova:instance>
Jul 24 15:30:49 user nova-compute[70645]:   </metadata>
Jul 24 15:30:49 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:30:49 user nova-compute[70645]:     <system>
Jul 24 15:30:49 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:30:49 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:30:49 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:30:49 user nova-compute[70645]:       <entry name="serial">8e71b884-58cb-415e-b3ef-221810e346ea</entry>
Jul 24 15:30:49 user nova-compute[70645]:       <entry name="uuid">8e71b884-58cb-415e-b3ef-221810e346ea</entry>
Jul 24 15:30:49 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:30:49 user nova-compute[70645]:     </system>
Jul 24 15:30:49 user nova-compute[70645]:   </sysinfo>
Jul 24 15:30:49 user nova-compute[70645]:   <os>
Jul 24 15:30:49 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:30:49 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:30:49 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:30:49 user nova-compute[70645]:   </os>
Jul 24 15:30:49 user nova-compute[70645]:   <features>
Jul 24 15:30:49 user nova-compute[70645]:     <acpi/>
Jul 24 15:30:49 user nova-compute[70645]:     <apic/>
Jul 24 15:30:49 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:30:49 user nova-compute[70645]:   </features>
Jul 24 15:30:49 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:30:49 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:30:49 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:30:49 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:30:49 user nova-compute[70645]:   </clock>
Jul 24 15:30:49 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:30:49 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:30:49 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:30:49 user nova-compute[70645]:   </cpu>
Jul 24 15:30:49 user nova-compute[70645]:   <devices>
Jul 24 15:30:49 user nova-compute[70645]:     <disk type="block" device="disk">
Jul 24 15:30:49 user nova-compute[70645]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:30:49 user nova-compute[70645]:       <source dev="/dev/sdc"/>
Jul 24 15:30:49 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:30:49 user nova-compute[70645]:       <serial>80677624-c170-48ec-bb40-9676dd3b2430</serial>
Jul 24 15:30:49 user nova-compute[70645]:     </disk>
Jul 24 15:30:49 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:30:49 user nova-compute[70645]:       <mac address="fa:16:3e:03:78:c1"/>
Jul 24 15:30:49 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:30:49 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:30:49 user nova-compute[70645]:       <target dev="tape0723d23-d7"/>
Jul 24 15:30:49 user nova-compute[70645]:     </interface>
Jul 24 15:30:49 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:30:49 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/8e71b884-58cb-415e-b3ef-221810e346ea/console.log" append="off"/>
Jul 24 15:30:49 user nova-compute[70645]:     </serial>
Jul 24 15:30:49 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:30:49 user nova-compute[70645]:     <video>
Jul 24 15:30:49 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:30:49 user nova-compute[70645]:     </video>
Jul 24 15:30:49 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:30:49 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:30:49 user nova-compute[70645]:     </rng>
Jul 24 15:30:49 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:30:49 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:30:49 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:30:49 user nova-compute[70645]:     </memballoon>
Jul 24 15:30:49 user nova-compute[70645]:   </devices>
Jul 24 15:30:49 user nova-compute[70645]: </domain>
Jul 24 15:30:49 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-948206049',display_name='tempest-TestVolumeBootPattern-server-948206049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-948206049',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTRyGHkNM/F7Uj8s1zbBGzq4u2ODBAATzdNxRyu6wHhbmJaesfIAOHgecueCfWN8rF4+FlyT1hvCe5vW8Raq9odIyX9yY69korPYjadjkJh7/JFICKyDrIiyoOtLEuJfw==',key_name='tempest-TestVolumeBootPattern-364022229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-edt78d10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:30:42Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=8e71b884-58cb-415e-b3ef-221810e346ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:78:c1,bridge_name='br-int',has_traffic_filtering=True,id=e0723d23-d758-42d3-bb04-f38c658b250c,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0723d23-d7') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG os_vif [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:78:c1,bridge_name='br-int',has_traffic_filtering=True,id=e0723d23-d758-42d3-bb04-f38c658b250c,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0723d23-d7') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0723d23-d7, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0723d23-d7, col_values=(('external_ids', {'iface-id': 'e0723d23-d758-42d3-bb04-f38c658b250c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:78:c1', 'vm-uuid': '8e71b884-58cb-415e-b3ef-221810e346ea'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:49 user nova-compute[70645]: INFO os_vif [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:78:c1,bridge_name='br-int',has_traffic_filtering=True,id=e0723d23-d758-42d3-bb04-f38c658b250c,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0723d23-d7')
Jul 24 15:30:49 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:30:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] No VIF found with MAC fa:16:3e:03:78:c1, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:30:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:30:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-4279d623-b5d3-4908-a47a-87790c46ea88 req-b0d1be39-e6f2-4a33-bf19-dd3d2789613e service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received event network-vif-plugged-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:30:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4279d623-b5d3-4908-a47a-87790c46ea88 req-b0d1be39-e6f2-4a33-bf19-dd3d2789613e service nova] Acquiring lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:30:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4279d623-b5d3-4908-a47a-87790c46ea88 req-b0d1be39-e6f2-4a33-bf19-dd3d2789613e service nova] Lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:30:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-4279d623-b5d3-4908-a47a-87790c46ea88 req-b0d1be39-e6f2-4a33-bf19-dd3d2789613e service nova] Lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:30:51 user nova-compute[70645]: DEBUG nova.compute.manager [req-4279d623-b5d3-4908-a47a-87790c46ea88 req-b0d1be39-e6f2-4a33-bf19-dd3d2789613e service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] No waiting events found dispatching network-vif-plugged-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:30:51 user nova-compute[70645]: WARNING nova.compute.manager [req-4279d623-b5d3-4908-a47a-87790c46ea88 req-b0d1be39-e6f2-4a33-bf19-dd3d2789613e service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received unexpected event network-vif-plugged-e0723d23-d758-42d3-bb04-f38c658b250c for instance with vm_state building and task_state spawning.
Jul 24 15:30:51 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:30:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:30:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:30:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:30:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:30:52 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updating instance_info_cache with network_info: [{"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:30:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:30:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:30:52 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:30:52 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212653.1610534, 8e71b884-58cb-415e-b3ef-221810e346ea => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:30:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] VM Resumed (Lifecycle Event)
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:30:53 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Instance spawned successfully.
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:30:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212653.1619663, 8e71b884-58cb-415e-b3ef-221810e346ea => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:30:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] VM Started (Lifecycle Event)
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:30:53 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:30:53 user nova-compute[70645]: INFO nova.compute.manager [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Took 4.84 seconds to spawn the instance on the hypervisor.
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-f737d59f-4e74-4136-b706-99da055ae780 req-9a9bfcfc-14ce-40fc-9a8c-fc9c9a775064 service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received event network-vif-plugged-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f737d59f-4e74-4136-b706-99da055ae780 req-9a9bfcfc-14ce-40fc-9a8c-fc9c9a775064 service nova] Acquiring lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f737d59f-4e74-4136-b706-99da055ae780 req-9a9bfcfc-14ce-40fc-9a8c-fc9c9a775064 service nova] Lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-f737d59f-4e74-4136-b706-99da055ae780 req-9a9bfcfc-14ce-40fc-9a8c-fc9c9a775064 service nova] Lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG nova.compute.manager [req-f737d59f-4e74-4136-b706-99da055ae780 req-9a9bfcfc-14ce-40fc-9a8c-fc9c9a775064 service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] No waiting events found dispatching network-vif-plugged-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:30:53 user nova-compute[70645]: WARNING nova.compute.manager [req-f737d59f-4e74-4136-b706-99da055ae780 req-9a9bfcfc-14ce-40fc-9a8c-fc9c9a775064 service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received unexpected event network-vif-plugged-e0723d23-d758-42d3-bb04-f38c658b250c for instance with vm_state building and task_state spawning.
Jul 24 15:30:53 user nova-compute[70645]: INFO nova.compute.manager [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Took 11.81 seconds to build instance.
Jul 24 15:30:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-90a85a2f-91b7-4a5a-b993-c9b9a2b8703f tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "8e71b884-58cb-415e-b3ef-221810e346ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.909s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:30:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:30:59 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:31:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG nova.objects.instance [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:31:08 user nova-compute[70645]: INFO nova.compute.manager [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attaching volume ee95e55b-4001-4ad4-9d72-9af5e192d7d7 to /dev/vdb
Jul 24 15:31:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG os_brick.utils [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bfb8f7-783e-4b90-b60a-447ad7a915e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2c67ad-3dbb-4b58-b5ce-64f8423a2763]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[de06d856-fcb6-472f-94de-aa1b5c8bc3aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcf91ed-22a7-492e-aeb1-247639548c71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:08 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:31:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:31:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:09 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:31:09 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:31:09 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6150fbfb-ed68-470f-bd89-5af236644f25]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:31:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:31:09 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:31:09 user nova-compute[70645]: DEBUG os_brick.utils [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:31:09 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updating existing volume attachment record: 50341c1a-6483-428c-9406-c9975d106ceb {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:31:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmLsRlJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:31:15 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:31:15 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:31:15 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d941196a-5895-4bfc-9c4c-6a8ce9f49394]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:31:15 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acbcfb2-b059-47c2-8488-4068fc86745d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7] added
Jul 24 15:31:15 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6098d45f-baa2-4d8d-9cdb-7360f352dd9e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a531e8d0-3e9b-4924-8cb1-ef6884b7e60f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmLsRlJP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmLsRlJP" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[900dabae-19ef-46c6-b869-333ee14dcdc6]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SmLsRlJP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caa06c3-f0ce-4ef5-8747-d06e739ce498]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4a2364-d717-4da9-bde3-780a5b150c69]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:31:15 user nova-compute[70645]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)
Jul 24 15:31:15 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:31:15 user nova-compute[70645]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)
Jul 24 15:31:15 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf7bb5-3a03-4880-9295-7177597ee318]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7, portal: 172.16.0.220,3260]
Jul 24 15:31:15 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7, portal: 172.16.0.220,3260] successful.
Jul 24 15:31:15 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24eaf62-11ad-4cc4-87ac-ad0d71acac15]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ef4aa5-8052-4921-8c38-c987e1c5d839]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:31:15 user nova-compute[70645]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)
Jul 24 15:31:15 user nova-compute[70645]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 (non-flash)
Jul 24 15:31:15 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:31:15 user nova-compute[70645]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)
Jul 24 15:31:15 user nova-compute[70645]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 (non-flash)
Jul 24 15:31:15 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] HCTL ('35', '-', '-', 0) found on session 62 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a951126-ee0e-4d8e-b5b5-6a327a2f97ea]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Searching for a device in session 62 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:31:15 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmLsRlJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:31:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:31:16 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23764636337373032', 'path': '/dev/sdd'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:31:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764636337373032', 'path': '/dev/sdd'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:31:16 user nova-compute[70645]: DEBUG nova.objects.instance [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:31:16 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:31:16 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:31:16 user nova-compute[70645]:   <source dev="/dev/sdd"/>
Jul 24 15:31:16 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:31:16 user nova-compute[70645]:   <serial>ee95e55b-4001-4ad4-9d72-9af5e192d7d7</serial>
Jul 24 15:31:16 user nova-compute[70645]: </disk>
Jul 24 15:31:16 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:31:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:31:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:31:17 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] No VIF found with MAC fa:16:3e:f4:e0:f4, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:31:17 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-31841f98-3e47-4f5d-a2a6-8b77a6b79d68 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.050s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:31:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:31:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:31:19 user nova-compute[70645]: INFO nova.compute.manager [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Detaching volume ee95e55b-4001-4ad4-9d72-9af5e192d7d7
Jul 24 15:31:19 user nova-compute[70645]: INFO nova.virt.block_device [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Attempting to driver detach volume ee95e55b-4001-4ad4-9d72-9af5e192d7d7 from mountpoint /dev/vdb
Jul 24 15:31:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Attempting to detach device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:31:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:31:19 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:31:19 user nova-compute[70645]:   <source dev="/dev/sdd"/>
Jul 24 15:31:19 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:31:19 user nova-compute[70645]:   <serial>ee95e55b-4001-4ad4-9d72-9af5e192d7d7</serial>
Jul 24 15:31:19 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:31:19 user nova-compute[70645]: </disk>
Jul 24 15:31:19 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:31:19 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Successfully detached device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the persistent domain config.
Jul 24 15:31:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:31:19 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:31:19 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:31:19 user nova-compute[70645]:   <source dev="/dev/sdd"/>
Jul 24 15:31:19 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:31:19 user nova-compute[70645]:   <serial>ee95e55b-4001-4ad4-9d72-9af5e192d7d7</serial>
Jul 24 15:31:19 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:31:19 user nova-compute[70645]: </disk>
Jul 24 15:31:19 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:31:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690212680.089803, 38fd9832-4406-49fb-bd96-265c8e74740d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:31:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Successfully detached device vdb from instance 38fd9832-4406-49fb-bd96-265c8e74740d from the live domain config.
Jul 24 15:31:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmLsRlJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:31:20 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[99db8894-6336-4961-b9fd-1eecd68906aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2efdbc-de60-4f4b-9923-0f63e8a4d62a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:31:20 user nova-compute[70645]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)
Jul 24 15:31:20 user nova-compute[70645]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 (non-flash)
Jul 24 15:31:20 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:31:20 user nova-compute[70645]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)
Jul 24 15:31:20 user nova-compute[70645]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 (non-flash)
Jul 24 15:31:20 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba8467acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7'): ({'sdd'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Removing single pathed devices sdd {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c59972d-634b-4c50-95bb-e0477eceb8f2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a5a5f2-0aab-4a80-9cde-dcedc518b9b6]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Flushing IO for device /dev/sdd {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63363d0-371e-4b1e-91de-16ed5f63add9]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[19463e5d-a8f3-4363-a4ff-ca76542297ed]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] SCSI volumes sdd have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b44346-5e38-488a-a67b-7661e42b86ee]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[503228cb-677b-4201-be42-21c107d55992]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7, portal: 172.16.0.220,3260]
Jul 24 15:31:20 user nova-compute[70645]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7, portal: 172.16.0.220,3260] successful.
Jul 24 15:31:20 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee95e55b-4001-4ad4-9d72-9af5e192d7d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfd6954-cda7-45b8-bfa8-6c6420071494]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] <== disconnect_volume: return (268ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:31:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:31:21 user nova-compute[70645]: DEBUG nova.objects.instance [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'flavor' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:31:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-327dd15f-21a1-4b41-8eeb-90246046025b tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.578s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:31:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:31:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:31:48 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:31:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:31:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:31:48 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:31:48 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:31:49 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:31:49 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:31:49 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8610MB free_disk=25.294219970703125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 38fd9832-4406-49fb-bd96-265c8e74740d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 8e71b884-58cb-415e-b3ef-221810e346ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:31:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:31:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:31:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:31:51 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:31:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:31:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:31:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:31:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:31:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:31:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:31:53 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:31:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updating instance_info_cache with network_info: [{"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:31:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-38fd9832-4406-49fb-bd96-265c8e74740d" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:31:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:31:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:31:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:31:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:31:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:31:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:32:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:31 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:31 user nova-compute[70645]: INFO nova.compute.manager [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Terminating instance
Jul 24 15:32:31 user nova-compute[70645]: DEBUG nova.compute.manager [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:32:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Instance destroyed successfully.
Jul 24 15:32:32 user nova-compute[70645]: DEBUG nova.objects.instance [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lazy-loading 'resources' on Instance uuid 38fd9832-4406-49fb-bd96-265c8e74740d {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:25:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-284966359',display_name='tempest-SnapshotDataIntegrityTests-server-284966359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-284966359',id=48,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj8TRnEwVYL1ULNHPLlkc0xuOaLAM2eV+8/X8KJQ+Yqnh4tlACFgN33I2QmamWsSpGNZCVcJF1ZoHxKvoZAsaZ+AzW+WYMnFDsDTd1j9v8ncupz62qV8D01Kj86xYGVMg==',key_name='tempest-keypair-1798457285',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:25:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a453eb6891a54cd48ec92ee0ad6b01f8',ramdisk_id='',reservation_id='r-jgq7k1fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1036015419',owner_user_name='tempest-SnapshotDataIntegrityTests-1036015419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:25:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302fa8ddc4f44c1d951b6ab06fecde6b',uuid=38fd9832-4406-49fb-bd96-265c8e74740d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Converting VIF {"id": "9c82f167-a114-424c-ab4b-0b69db3724e3", "address": "fa:16:3e:f4:e0:f4", "network": {"id": "21d2a7ea-b5fc-4d19-8147-20255fe4cd23", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718496266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a453eb6891a54cd48ec92ee0ad6b01f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c82f167-a1", "ovs_interfaceid": "9c82f167-a114-424c-ab4b-0b69db3724e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:e0:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c82f167-a114-424c-ab4b-0b69db3724e3,network=Network(21d2a7ea-b5fc-4d19-8147-20255fe4cd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c82f167-a1') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG os_vif [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:e0:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c82f167-a114-424c-ab4b-0b69db3724e3,network=Network(21d2a7ea-b5fc-4d19-8147-20255fe4cd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c82f167-a1') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c82f167-a1, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:32:32 user nova-compute[70645]: INFO os_vif [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:e0:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c82f167-a114-424c-ab4b-0b69db3724e3,network=Network(21d2a7ea-b5fc-4d19-8147-20255fe4cd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c82f167-a1')
Jul 24 15:32:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Deleting instance files /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d_del
Jul 24 15:32:32 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Deletion of /opt/stack/data/nova/instances/38fd9832-4406-49fb-bd96-265c8e74740d_del complete
Jul 24 15:32:32 user nova-compute[70645]: INFO nova.compute.manager [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 24 15:32:32 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-598dbb9b-c74a-48a6-a01e-6d25030803a9 req-52975630-326b-4c69-8121-9dbc333b67ce service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Received event network-vif-unplugged-9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-598dbb9b-c74a-48a6-a01e-6d25030803a9 req-52975630-326b-4c69-8121-9dbc333b67ce service nova] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-598dbb9b-c74a-48a6-a01e-6d25030803a9 req-52975630-326b-4c69-8121-9dbc333b67ce service nova] Lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-598dbb9b-c74a-48a6-a01e-6d25030803a9 req-52975630-326b-4c69-8121-9dbc333b67ce service nova] Lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-598dbb9b-c74a-48a6-a01e-6d25030803a9 req-52975630-326b-4c69-8121-9dbc333b67ce service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] No waiting events found dispatching network-vif-unplugged-9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:32:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-598dbb9b-c74a-48a6-a01e-6d25030803a9 req-52975630-326b-4c69-8121-9dbc333b67ce service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Received event network-vif-unplugged-9c82f167-a114-424c-ab4b-0b69db3724e3 for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:32:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:34 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:32:34 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Took 1.70 seconds to deallocate network for instance.
Jul 24 15:32:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:34 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:32:34 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:32:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:34 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Deleted allocations for instance 38fd9832-4406-49fb-bd96-265c8e74740d
Jul 24 15:32:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-df717053-e533-4c32-bb5f-2a64828ebfc6 req-496f49ad-742e-47a9-bc75-5c1df2ae0912 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Received event network-vif-plugged-9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:32:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-df717053-e533-4c32-bb5f-2a64828ebfc6 req-496f49ad-742e-47a9-bc75-5c1df2ae0912 service nova] Acquiring lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-df717053-e533-4c32-bb5f-2a64828ebfc6 req-496f49ad-742e-47a9-bc75-5c1df2ae0912 service nova] Lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-df717053-e533-4c32-bb5f-2a64828ebfc6 req-496f49ad-742e-47a9-bc75-5c1df2ae0912 service nova] Lock "38fd9832-4406-49fb-bd96-265c8e74740d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-df717053-e533-4c32-bb5f-2a64828ebfc6 req-496f49ad-742e-47a9-bc75-5c1df2ae0912 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] No waiting events found dispatching network-vif-plugged-9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:32:34 user nova-compute[70645]: WARNING nova.compute.manager [req-df717053-e533-4c32-bb5f-2a64828ebfc6 req-496f49ad-742e-47a9-bc75-5c1df2ae0912 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Received unexpected event network-vif-plugged-9c82f167-a114-424c-ab4b-0b69db3724e3 for instance with vm_state deleted and task_state None.
Jul 24 15:32:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-df717053-e533-4c32-bb5f-2a64828ebfc6 req-496f49ad-742e-47a9-bc75-5c1df2ae0912 service nova] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Received event network-vif-deleted-9c82f167-a114-424c-ab4b-0b69db3724e3 {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:32:34 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-74f0cb84-3457-4b24-b7a2-691f811c00f5 tempest-SnapshotDataIntegrityTests-1036015419 tempest-SnapshotDataIntegrityTests-1036015419-project-member] Lock "38fd9832-4406-49fb-bd96-265c8e74740d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.998s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-9eb12416-f6d8-4a45-a312-57210720cf23 req-e0a97d1b-b667-4dc9-bc51-b5290140d6a5 service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received event network-changed-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:32:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-9eb12416-f6d8-4a45-a312-57210720cf23 req-e0a97d1b-b667-4dc9-bc51-b5290140d6a5 service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Refreshing instance network info cache due to event network-changed-e0723d23-d758-42d3-bb04-f38c658b250c. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:32:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9eb12416-f6d8-4a45-a312-57210720cf23 req-e0a97d1b-b667-4dc9-bc51-b5290140d6a5 service nova] Acquiring lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:32:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9eb12416-f6d8-4a45-a312-57210720cf23 req-e0a97d1b-b667-4dc9-bc51-b5290140d6a5 service nova] Acquired lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:32:35 user nova-compute[70645]: DEBUG nova.network.neutron [req-9eb12416-f6d8-4a45-a312-57210720cf23 req-e0a97d1b-b667-4dc9-bc51-b5290140d6a5 service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Refreshing network info cache for port e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:32:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "8e71b884-58cb-415e-b3ef-221810e346ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "8e71b884-58cb-415e-b3ef-221810e346ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:35 user nova-compute[70645]: INFO nova.compute.manager [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Terminating instance
Jul 24 15:32:35 user nova-compute[70645]: DEBUG nova.compute.manager [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:32:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-5d1021a5-bbe8-4f02-93af-0116ef7e7d12 req-a85334f2-b48f-400b-8704-8497e8e68cad service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received event network-vif-unplugged-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5d1021a5-bbe8-4f02-93af-0116ef7e7d12 req-a85334f2-b48f-400b-8704-8497e8e68cad service nova] Acquiring lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5d1021a5-bbe8-4f02-93af-0116ef7e7d12 req-a85334f2-b48f-400b-8704-8497e8e68cad service nova] Lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-5d1021a5-bbe8-4f02-93af-0116ef7e7d12 req-a85334f2-b48f-400b-8704-8497e8e68cad service nova] Lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-5d1021a5-bbe8-4f02-93af-0116ef7e7d12 req-a85334f2-b48f-400b-8704-8497e8e68cad service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] No waiting events found dispatching network-vif-unplugged-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-5d1021a5-bbe8-4f02-93af-0116ef7e7d12 req-a85334f2-b48f-400b-8704-8497e8e68cad service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received event network-vif-unplugged-e0723d23-d758-42d3-bb04-f38c658b250c for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.network.neutron [req-9eb12416-f6d8-4a45-a312-57210720cf23 req-e0a97d1b-b667-4dc9-bc51-b5290140d6a5 service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Updated VIF entry in instance network info cache for port e0723d23-d758-42d3-bb04-f38c658b250c. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.network.neutron [req-9eb12416-f6d8-4a45-a312-57210720cf23 req-e0a97d1b-b667-4dc9-bc51-b5290140d6a5 service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Updating instance_info_cache with network_info: [{"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9eb12416-f6d8-4a45-a312-57210720cf23 req-e0a97d1b-b667-4dc9-bc51-b5290140d6a5 service nova] Releasing lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:36 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Instance destroyed successfully.
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.objects.instance [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'resources' on Instance uuid 8e71b884-58cb-415e-b3ef-221810e346ea {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-948206049',display_name='tempest-TestVolumeBootPattern-server-948206049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-948206049',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTRyGHkNM/F7Uj8s1zbBGzq4u2ODBAATzdNxRyu6wHhbmJaesfIAOHgecueCfWN8rF4+FlyT1hvCe5vW8Raq9odIyX9yY69korPYjadjkJh7/JFICKyDrIiyoOtLEuJfw==',key_name='tempest-TestVolumeBootPattern-364022229',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:30:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-edt78d10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:30:53Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=8e71b884-58cb-415e-b3ef-221810e346ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:78:c1,bridge_name='br-int',has_traffic_filtering=True,id=e0723d23-d758-42d3-bb04-f38c658b250c,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0723d23-d7') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG os_vif [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:78:c1,bridge_name='br-int',has_traffic_filtering=True,id=e0723d23-d758-42d3-bb04-f38c658b250c,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0723d23-d7') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0723d23-d7, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:32:36 user nova-compute[70645]: INFO os_vif [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:78:c1,bridge_name='br-int',has_traffic_filtering=True,id=e0723d23-d758-42d3-bb04-f38c658b250c,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0723d23-d7')
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVdSBiPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:32:36 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:32:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d94a77a-9c63-41e0-97dd-b138cab244c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0797756-dcf8-412d-ae9a-b90944b52faf]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:32:36 user nova-compute[70645]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)
Jul 24 15:32:36 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:32:36 user nova-compute[70645]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 (non-flash)
Jul 24 15:32:36 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba606bd120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430'): ({'sdc'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Removing single pathed devices sdc {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61213a7-92f8-4626-b8de-898203e009e0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58963b6-cb47-4103-b307-ebe2822b3ce7]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flushing IO for device /dev/sdc {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-44bfbdec-57c9-4b89-a7bd-f08370dc2200 req-396192e9-afe6-45f1-bfd1-72241ec52ecc service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received event network-changed-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.compute.manager [req-44bfbdec-57c9-4b89-a7bd-f08370dc2200 req-396192e9-afe6-45f1-bfd1-72241ec52ecc service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Refreshing instance network info cache due to event network-changed-e0723d23-d758-42d3-bb04-f38c658b250c. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-44bfbdec-57c9-4b89-a7bd-f08370dc2200 req-396192e9-afe6-45f1-bfd1-72241ec52ecc service nova] Acquiring lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-44bfbdec-57c9-4b89-a7bd-f08370dc2200 req-396192e9-afe6-45f1-bfd1-72241ec52ecc service nova] Acquired lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG nova.network.neutron [req-44bfbdec-57c9-4b89-a7bd-f08370dc2200 req-396192e9-afe6-45f1-bfd1-72241ec52ecc service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Refreshing network info cache for port e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24e0cf7-212e-48c8-8c5d-2c4d3809bd05]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:32:36 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.068s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7a693e-13b3-46ab-aaa4-9b66726a21dc]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] SCSI volumes sdc have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e54d9239', '/dev/disk/by-id/scsi-26561623535316639', '/dev/disk/by-id/scsi-1SCST_BIOe54d9239-eab551f9ab83dbd2') {{(pid=81509) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aed14d-1fa1-43b3-8ddf-5f3e161b2c24]: (4, None) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9771235-e16a-4dfe-b8a2-6422f7eb569a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8097df-2b6c-4bb8-a349-fff08fa315df]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430, portal: 172.16.0.220,3260]
Jul 24 15:32:37 user nova-compute[70645]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430, portal: 172.16.0.220,3260] successful.
Jul 24 15:32:37 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80677624-c170-48ec-bb40-9676dd3b2430 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd8b1e-2ce9-4e8d-aaa9-c92b9987b8bf]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== disconnect_volume: return (320ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:32:37 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Deleting instance files /opt/stack/data/nova/instances/8e71b884-58cb-415e-b3ef-221810e346ea_del
Jul 24 15:32:37 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Deletion of /opt/stack/data/nova/instances/8e71b884-58cb-415e-b3ef-221810e346ea_del complete
Jul 24 15:32:37 user nova-compute[70645]: INFO nova.compute.manager [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Took 1.31 seconds to destroy the instance on the hypervisor.
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-44bfbdec-57c9-4b89-a7bd-f08370dc2200 req-396192e9-afe6-45f1-bfd1-72241ec52ecc service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Updated VIF entry in instance network info cache for port e0723d23-d758-42d3-bb04-f38c658b250c. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG nova.network.neutron [req-44bfbdec-57c9-4b89-a7bd-f08370dc2200 req-396192e9-afe6-45f1-bfd1-72241ec52ecc service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Updating instance_info_cache with network_info: [{"id": "e0723d23-d758-42d3-bb04-f38c658b250c", "address": "fa:16:3e:03:78:c1", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0723d23-d7", "ovs_interfaceid": "e0723d23-d758-42d3-bb04-f38c658b250c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-44bfbdec-57c9-4b89-a7bd-f08370dc2200 req-396192e9-afe6-45f1-bfd1-72241ec52ecc service nova] Releasing lock "refresh_cache-8e71b884-58cb-415e-b3ef-221810e346ea" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:32:37 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:32:37 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Took 0.58 seconds to deallocate network for instance.
Jul 24 15:32:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-352c4476-d243-407a-9a8e-c97e00470b4e req-01b04a30-f703-45a0-a17a-c268c251a19d service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received event network-vif-plugged-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:32:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-352c4476-d243-407a-9a8e-c97e00470b4e req-01b04a30-f703-45a0-a17a-c268c251a19d service nova] Acquiring lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-352c4476-d243-407a-9a8e-c97e00470b4e req-01b04a30-f703-45a0-a17a-c268c251a19d service nova] Lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-352c4476-d243-407a-9a8e-c97e00470b4e req-01b04a30-f703-45a0-a17a-c268c251a19d service nova] Lock "8e71b884-58cb-415e-b3ef-221810e346ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-352c4476-d243-407a-9a8e-c97e00470b4e req-01b04a30-f703-45a0-a17a-c268c251a19d service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] No waiting events found dispatching network-vif-plugged-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:32:38 user nova-compute[70645]: WARNING nova.compute.manager [req-352c4476-d243-407a-9a8e-c97e00470b4e req-01b04a30-f703-45a0-a17a-c268c251a19d service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received unexpected event network-vif-plugged-e0723d23-d758-42d3-bb04-f38c658b250c for instance with vm_state active and task_state deleting.
Jul 24 15:32:38 user nova-compute[70645]: DEBUG nova.compute.manager [req-352c4476-d243-407a-9a8e-c97e00470b4e req-01b04a30-f703-45a0-a17a-c268c251a19d service nova] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Received event network-vif-deleted-e0723d23-d758-42d3-bb04-f38c658b250c {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:32:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:38 user nova-compute[70645]: INFO nova.compute.manager [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Took 0.81 seconds to detach 1 volumes for instance.
Jul 24 15:32:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:38 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:32:38 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:32:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:38 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Deleted allocations for instance 8e71b884-58cb-415e-b3ef-221810e346ea
Jul 24 15:32:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-5ae23cb7-a2c1-4b61-8f4e-15cc6df94d7a tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "8e71b884-58cb-415e-b3ef-221810e346ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.006s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:41 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:46 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:32:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:32:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:32:47 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690212752.6792452, 38fd9832-4406-49fb-bd96-265c8e74740d => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:32:47 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] VM Stopped (Lifecycle Event)
Jul 24 15:32:47 user nova-compute[70645]: DEBUG nova.compute.manager [None req-d09fd80d-fa04-4421-ab28-570c8f3d4193 None None] [instance: 38fd9832-4406-49fb-bd96-265c8e74740d] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:32:49 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:32:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:32:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:50 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:50 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70645) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 15:32:51 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:32:51 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:32:51 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=25.3209228515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690212756.7396097, 8e71b884-58cb-415e-b3ef-221810e346ea => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:32:51 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] VM Stopped (Lifecycle Event)
Jul 24 15:32:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-dfe5152e-9426-437d-b8ae-f0967fb53e20 None None] [instance: 8e71b884-58cb-415e-b3ef-221810e346ea] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:32:51 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:32:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:32:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:32:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:32:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:32:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:32:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:32:53 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:32:54 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updating instance_info_cache with network_info: [{"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:32:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:32:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:32:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:32:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:32:55 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:32:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:32:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:32:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:32:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:32:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:32:56 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:00 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:33:01 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:06 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:33:11 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:33:16 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:33:21 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:30 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:31 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-ffd71054-6814-43e0-87e6-5e752be6b513 req-56079d06-bb2c-4a0d-9d47-3e70eeac3994 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received event network-changed-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG nova.compute.manager [req-ffd71054-6814-43e0-87e6-5e752be6b513 req-56079d06-bb2c-4a0d-9d47-3e70eeac3994 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Refreshing instance network info cache due to event network-changed-d9dc06a2-46e6-4079-aa7e-858853df56ff. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ffd71054-6814-43e0-87e6-5e752be6b513 req-56079d06-bb2c-4a0d-9d47-3e70eeac3994 service nova] Acquiring lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ffd71054-6814-43e0-87e6-5e752be6b513 req-56079d06-bb2c-4a0d-9d47-3e70eeac3994 service nova] Acquired lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG nova.network.neutron [req-ffd71054-6814-43e0-87e6-5e752be6b513 req-56079d06-bb2c-4a0d-9d47-3e70eeac3994 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Refreshing network info cache for port d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:33:32 user nova-compute[70645]: INFO nova.compute.manager [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Terminating instance
Jul 24 15:33:32 user nova-compute[70645]: DEBUG nova.compute.manager [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:32 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-9331802d-da40-42e2-b468-b3163dbc98ff req-65b4e423-604d-4208-95b0-a905a04ea654 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received event network-vif-unplugged-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9331802d-da40-42e2-b468-b3163dbc98ff req-65b4e423-604d-4208-95b0-a905a04ea654 service nova] Acquiring lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9331802d-da40-42e2-b468-b3163dbc98ff req-65b4e423-604d-4208-95b0-a905a04ea654 service nova] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-9331802d-da40-42e2-b468-b3163dbc98ff req-65b4e423-604d-4208-95b0-a905a04ea654 service nova] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-9331802d-da40-42e2-b468-b3163dbc98ff req-65b4e423-604d-4208-95b0-a905a04ea654 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] No waiting events found dispatching network-vif-unplugged-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.compute.manager [req-9331802d-da40-42e2-b468-b3163dbc98ff req-65b4e423-604d-4208-95b0-a905a04ea654 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received event network-vif-unplugged-d9dc06a2-46e6-4079-aa7e-858853df56ff for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.network.neutron [req-ffd71054-6814-43e0-87e6-5e752be6b513 req-56079d06-bb2c-4a0d-9d47-3e70eeac3994 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updated VIF entry in instance network info cache for port d9dc06a2-46e6-4079-aa7e-858853df56ff. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.network.neutron [req-ffd71054-6814-43e0-87e6-5e752be6b513 req-56079d06-bb2c-4a0d-9d47-3e70eeac3994 service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updating instance_info_cache with network_info: [{"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-ffd71054-6814-43e0-87e6-5e752be6b513 req-56079d06-bb2c-4a0d-9d47-3e70eeac3994 service nova] Releasing lock "refresh_cache-815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:33:33 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Instance destroyed successfully.
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.objects.instance [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lazy-loading 'resources' on Instance uuid 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-250526914',display_name='tempest-TestVolumeBootPattern-server-250526914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-250526914',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTRyGHkNM/F7Uj8s1zbBGzq4u2ODBAATzdNxRyu6wHhbmJaesfIAOHgecueCfWN8rF4+FlyT1hvCe5vW8Raq9odIyX9yY69korPYjadjkJh7/JFICKyDrIiyoOtLEuJfw==',key_name='tempest-TestVolumeBootPattern-364022229',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:28:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f92f320224c4b1e98b371f510a5e198',ramdisk_id='',reservation_id='r-h82sufyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1424700934',owner_user_name='tempest-TestVolumeBootPattern-1424700934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:28:59Z,user_data=None,user_id='a83e71e487ca401eb10e1d41d77b86fe',uuid=815fdfff-2de8-4c7c-a4e5-8a470a8aea7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converting VIF {"id": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "address": "fa:16:3e:ad:99:7f", "network": {"id": "8ec0c982-96c1-42b5-a1b8-5c525261c081", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2113235022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f92f320224c4b1e98b371f510a5e198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc06a2-46", "ovs_interfaceid": "d9dc06a2-46e6-4079-aa7e-858853df56ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:99:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9dc06a2-46e6-4079-aa7e-858853df56ff,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc06a2-46') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_vif [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:99:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9dc06a2-46e6-4079-aa7e-858853df56ff,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc06a2-46') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9dc06a2-46, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:33:33 user nova-compute[70645]: INFO os_vif [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:99:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9dc06a2-46e6-4079-aa7e-858853df56ff,network=Network(8ec0c982-96c1-42b5-a1b8-5c525261c081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc06a2-46')
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwnvVkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:33:33 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8e7913-c8a7-462e-8b3b-1f520edbe883]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b52bd0b-ea70-4ece-9552-6e9e711281e7]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:33:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea (non-flash)
Jul 24 15:33:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba94145cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbec67ea-4d9f-409f-a2f6-879fbf802b55]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d27237a-ff80-47c1-a692-aa4c0e84b0dc]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a31f1b5-d105-4d33-acee-0c3d23cb1575]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c667bfa9-d552-40c8-b4b0-ea7c397cb6d3]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4b2dfef-b893caa21c2f1dd8', '/dev/disk/by-id/scsi-26238393363616132', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4b2dfef') {{(pid=81509) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10e2887-6fb3-46cf-acb3-ea4740ccd45f]: (4, None) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba6e89f-85c0-47d9-98c2-62e27c65e06e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d04604-3174-4e38-987d-b6d52476d2f4]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260]
Jul 24 15:33:33 user nova-compute[70645]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea, portal: 172.16.0.220,3260] successful.
Jul 24 15:33:33 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac230bca-69f7-4820-9891-383465fbeaea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac6aec2-e0de-47d0-a4c2-7fbd87dbd20a]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] <== disconnect_volume: return (277ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:33:33 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Deleting instance files /opt/stack/data/nova/instances/815fdfff-2de8-4c7c-a4e5-8a470a8aea7c_del
Jul 24 15:33:33 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Deletion of /opt/stack/data/nova/instances/815fdfff-2de8-4c7c-a4e5-8a470a8aea7c_del complete
Jul 24 15:33:33 user nova-compute[70645]: INFO nova.compute.manager [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Took 1.13 seconds to destroy the instance on the hypervisor.
Jul 24 15:33:33 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:33:33 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:33:34 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:33:34 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Took 0.49 seconds to deallocate network for instance.
Jul 24 15:33:34 user nova-compute[70645]: DEBUG nova.compute.manager [req-5989a505-6956-4d96-8b77-fc9b285b1b57 req-51dea3ca-0837-4066-9d26-8e0d00a2da6f service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received event network-vif-deleted-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:33:35 user nova-compute[70645]: INFO nova.compute.manager [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Took 0.70 seconds to detach 1 volumes for instance.
Jul 24 15:33:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-8e832032-1617-46e4-8260-216e99f9b1d5 req-f1513cfc-9f98-4337-aebc-25912418c62b service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received event network-vif-plugged-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:33:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8e832032-1617-46e4-8260-216e99f9b1d5 req-f1513cfc-9f98-4337-aebc-25912418c62b service nova] Acquiring lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:33:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8e832032-1617-46e4-8260-216e99f9b1d5 req-f1513cfc-9f98-4337-aebc-25912418c62b service nova] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:33:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-8e832032-1617-46e4-8260-216e99f9b1d5 req-f1513cfc-9f98-4337-aebc-25912418c62b service nova] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:33:35 user nova-compute[70645]: DEBUG nova.compute.manager [req-8e832032-1617-46e4-8260-216e99f9b1d5 req-f1513cfc-9f98-4337-aebc-25912418c62b service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] No waiting events found dispatching network-vif-plugged-d9dc06a2-46e6-4079-aa7e-858853df56ff {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:33:35 user nova-compute[70645]: WARNING nova.compute.manager [req-8e832032-1617-46e4-8260-216e99f9b1d5 req-f1513cfc-9f98-4337-aebc-25912418c62b service nova] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Received unexpected event network-vif-plugged-d9dc06a2-46e6-4079-aa7e-858853df56ff for instance with vm_state active and task_state deleting.
Jul 24 15:33:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:33:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:33:35 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:33:35 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:33:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:33:35 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Deleted allocations for instance 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c
Jul 24 15:33:35 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-681568fc-81df-4d6c-bf69-66c3a97e1beb tempest-TestVolumeBootPattern-1424700934 tempest-TestVolumeBootPattern-1424700934-project-member] Lock "815fdfff-2de8-4c7c-a4e5-8a470a8aea7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.617s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:33:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:33:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:33:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:33:48 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690212813.5630167, 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:33:48 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] VM Stopped (Lifecycle Event)
Jul 24 15:33:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-1cfbed80-e311-4912-8855-5bfcfa45d9dc None None] [instance: 815fdfff-2de8-4c7c-a4e5-8a470a8aea7c] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:33:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:33:52 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:33:52 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:33:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:33:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:33:52 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:33:52 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:33:53 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:33:53 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:33:53 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=25.319236755371094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:33:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:33:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:33:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:33:55 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:33:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:33:55 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 15:33:55 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:33:56 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:33:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:34:06 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:34:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 15:34:06 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] There are 0 instances to clean {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 15:34:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:34:11 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:34:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:34:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:34:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:34:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:34:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:34:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:28 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:34:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70645) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 15:34:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:34:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:46 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:34:46 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:34:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:34:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:34:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:34:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:34:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:34:52 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:34:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:34:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:34:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:34:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:34:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:34:53 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:34:54 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:34:54 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:34:54 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=25.317752838134766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing inventories for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Updating ProviderTree inventory for provider a0cf5b80-69d2-4191-894e-a498eab7d688 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing aggregate associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, aggregates: None {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing trait associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:34:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:34:56 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:34:56 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:34:56 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:34:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:34:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:34:56 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 15:34:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:34:58 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:35:02 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:04 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:35:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:08 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:35:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:35:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Starting instance... {{(pid=70645) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 15:35:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:35:19 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:35:19 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70645) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 15:35:19 user nova-compute[70645]: INFO nova.compute.claims [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Claim successful on node user
Jul 24 15:35:20 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Start building networks asynchronously for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Allocating IP information in the background. {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] allocate_for_instance() {{(pid=70645) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 15:35:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 15:35:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Start building block device mappings for instance. {{(pid=70645) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Start spawning the instance on the hypervisor. {{(pid=70645) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Creating instance directory {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 15:35:20 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Creating image(s)
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "/opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "/opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "/opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.160s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "a9158b703961a7524219ee5bad1d130066a04e9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG nova.policy [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cdee3cff5434b20be90bd226f2c66b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8537750dd6264a7bb126d7ca45c72fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70645) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.158s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk 1073741824 {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b,backing_fmt=raw /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk 1073741824" returned: 0 in 0.061s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "a9158b703961a7524219ee5bad1d130066a04e9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:35:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:35:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9158b703961a7524219ee5bad1d130066a04e9b --force-share --output=json" returned: 0 in 0.164s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:35:21 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk. size=1073741824 {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 15:35:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:35:21 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:35:21 user nova-compute[70645]: DEBUG nova.virt.disk.api [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Cannot resize image /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk to a smaller size. {{(pid=70645) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 15:35:21 user nova-compute[70645]: DEBUG nova.objects.instance [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'migration_context' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:35:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Created local disks {{(pid=70645) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 15:35:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Ensure instance console log exists: /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/console.log {{(pid=70645) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 15:35:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:35:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:35:21 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:35:22 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Successfully created port: e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Successfully updated port: e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquired lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Building network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-bb19579c-3208-493b-bb8e-fb7552021f9a req-79f37237-0ad4-480a-a5ad-a3980981abb6 service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Received event network-changed-e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG nova.compute.manager [req-bb19579c-3208-493b-bb8e-fb7552021f9a req-79f37237-0ad4-480a-a5ad-a3980981abb6 service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Refreshing instance network info cache due to event network-changed-e44d3e35-0b88-422d-91a8-4a1f33cb484a. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb19579c-3208-493b-bb8e-fb7552021f9a req-79f37237-0ad4-480a-a5ad-a3980981abb6 service nova] Acquiring lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Instance cache missing network info. {{(pid=70645) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG nova.network.neutron [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating instance_info_cache with network_info: [{"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Releasing lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Instance network_info: |[{"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70645) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb19579c-3208-493b-bb8e-fb7552021f9a req-79f37237-0ad4-480a-a5ad-a3980981abb6 service nova] Acquired lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:35:23 user nova-compute[70645]: DEBUG nova.network.neutron [req-bb19579c-3208-493b-bb8e-fb7552021f9a req-79f37237-0ad4-480a-a5ad-a3980981abb6 service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Refreshing network info cache for port e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Start _get_guest_xml network_info=[{"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'b4bccd44-68c1-4fe3-8a56-c3963153c7de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 15:35:24 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:35:24 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] CPU controller missing on host. {{(pid=70645) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.host [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] CPU controller found on host. {{(pid=70645) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70645) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T14:48:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T14:48:37Z,direct_url=<?>,disk_format='qcow2',id=b4bccd44-68c1-4fe3-8a56-c3963153c7de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b65d0636576c475486adf5aa6fbed00f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T14:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Flavor limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Image limits 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Flavor pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Image pref 0:0:0 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Got 1 possible topologies {{(pid=70645) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.hardware [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70645) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:35:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-157778356',display_name='tempest-SnapshotDataIntegrityTests-server-157778356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-157778356',id=52,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHADp0YNOOpfGvPoEP7tdnsRF9WB4vV9z9oikHGEtwvvUwthBVNBSMP7VWBouXZUVWz69y4M83a6sZI85exxU/ksGrjosyK5bCqxseBpKAcTFr9cmmW8MXQ0NEwO1I3zsQ==',key_name='tempest-keypair-212544836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8537750dd6264a7bb126d7ca45c72fb6',ramdisk_id='',reservation_id='r-e7479a90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-91902892',owner_user_name='tempest-SnapshotDataIntegrityTests-91902892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:35:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cdee3cff5434b20be90bd226f2c66b1',uuid=56dcec39-834d-4107-895d-29c0afe9ed86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70645) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Converting VIF {"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=e44d3e35-0b88-422d-91a8-4a1f33cb484a,network=Network(0ca60fd7-f8ac-4500-b5de-52adf14379ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3e35-0b') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.objects.instance [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'pci_devices' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] End _get_guest_xml xml=<domain type="kvm">
Jul 24 15:35:24 user nova-compute[70645]:   <uuid>56dcec39-834d-4107-895d-29c0afe9ed86</uuid>
Jul 24 15:35:24 user nova-compute[70645]:   <name>instance-00000034</name>
Jul 24 15:35:24 user nova-compute[70645]:   <memory>524288</memory>
Jul 24 15:35:24 user nova-compute[70645]:   <vcpu>1</vcpu>
Jul 24 15:35:24 user nova-compute[70645]:   <metadata>
Jul 24 15:35:24 user nova-compute[70645]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 15:35:24 user nova-compute[70645]:       <nova:package version="0.0.0"/>
Jul 24 15:35:24 user nova-compute[70645]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-157778356</nova:name>
Jul 24 15:35:24 user nova-compute[70645]:       <nova:creationTime>2023-07-24 15:35:24</nova:creationTime>
Jul 24 15:35:24 user nova-compute[70645]:       <nova:flavor name="m1.tiny">
Jul 24 15:35:24 user nova-compute[70645]:         <nova:memory>512</nova:memory>
Jul 24 15:35:24 user nova-compute[70645]:         <nova:disk>1</nova:disk>
Jul 24 15:35:24 user nova-compute[70645]:         <nova:swap>0</nova:swap>
Jul 24 15:35:24 user nova-compute[70645]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 15:35:24 user nova-compute[70645]:         <nova:vcpus>1</nova:vcpus>
Jul 24 15:35:24 user nova-compute[70645]:       </nova:flavor>
Jul 24 15:35:24 user nova-compute[70645]:       <nova:owner>
Jul 24 15:35:24 user nova-compute[70645]:         <nova:user uuid="4cdee3cff5434b20be90bd226f2c66b1">tempest-SnapshotDataIntegrityTests-91902892-project-member</nova:user>
Jul 24 15:35:24 user nova-compute[70645]:         <nova:project uuid="8537750dd6264a7bb126d7ca45c72fb6">tempest-SnapshotDataIntegrityTests-91902892</nova:project>
Jul 24 15:35:24 user nova-compute[70645]:       </nova:owner>
Jul 24 15:35:24 user nova-compute[70645]:       <nova:root type="image" uuid="b4bccd44-68c1-4fe3-8a56-c3963153c7de"/>
Jul 24 15:35:24 user nova-compute[70645]:       <nova:ports>
Jul 24 15:35:24 user nova-compute[70645]:         <nova:port uuid="e44d3e35-0b88-422d-91a8-4a1f33cb484a">
Jul 24 15:35:24 user nova-compute[70645]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 15:35:24 user nova-compute[70645]:         </nova:port>
Jul 24 15:35:24 user nova-compute[70645]:       </nova:ports>
Jul 24 15:35:24 user nova-compute[70645]:     </nova:instance>
Jul 24 15:35:24 user nova-compute[70645]:   </metadata>
Jul 24 15:35:24 user nova-compute[70645]:   <sysinfo type="smbios">
Jul 24 15:35:24 user nova-compute[70645]:     <system>
Jul 24 15:35:24 user nova-compute[70645]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 15:35:24 user nova-compute[70645]:       <entry name="product">OpenStack Nova</entry>
Jul 24 15:35:24 user nova-compute[70645]:       <entry name="version">0.0.0</entry>
Jul 24 15:35:24 user nova-compute[70645]:       <entry name="serial">56dcec39-834d-4107-895d-29c0afe9ed86</entry>
Jul 24 15:35:24 user nova-compute[70645]:       <entry name="uuid">56dcec39-834d-4107-895d-29c0afe9ed86</entry>
Jul 24 15:35:24 user nova-compute[70645]:       <entry name="family">Virtual Machine</entry>
Jul 24 15:35:24 user nova-compute[70645]:     </system>
Jul 24 15:35:24 user nova-compute[70645]:   </sysinfo>
Jul 24 15:35:24 user nova-compute[70645]:   <os>
Jul 24 15:35:24 user nova-compute[70645]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 15:35:24 user nova-compute[70645]:     <boot dev="hd"/>
Jul 24 15:35:24 user nova-compute[70645]:     <smbios mode="sysinfo"/>
Jul 24 15:35:24 user nova-compute[70645]:   </os>
Jul 24 15:35:24 user nova-compute[70645]:   <features>
Jul 24 15:35:24 user nova-compute[70645]:     <acpi/>
Jul 24 15:35:24 user nova-compute[70645]:     <apic/>
Jul 24 15:35:24 user nova-compute[70645]:     <vmcoreinfo/>
Jul 24 15:35:24 user nova-compute[70645]:   </features>
Jul 24 15:35:24 user nova-compute[70645]:   <clock offset="utc">
Jul 24 15:35:24 user nova-compute[70645]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 15:35:24 user nova-compute[70645]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 15:35:24 user nova-compute[70645]:     <timer name="hpet" present="no"/>
Jul 24 15:35:24 user nova-compute[70645]:   </clock>
Jul 24 15:35:24 user nova-compute[70645]:   <cpu mode="custom" match="exact">
Jul 24 15:35:24 user nova-compute[70645]:     <model>Nehalem</model>
Jul 24 15:35:24 user nova-compute[70645]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 15:35:24 user nova-compute[70645]:   </cpu>
Jul 24 15:35:24 user nova-compute[70645]:   <devices>
Jul 24 15:35:24 user nova-compute[70645]:     <disk type="file" device="disk">
Jul 24 15:35:24 user nova-compute[70645]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 15:35:24 user nova-compute[70645]:       <source file="/opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk"/>
Jul 24 15:35:24 user nova-compute[70645]:       <target dev="vda" bus="virtio"/>
Jul 24 15:35:24 user nova-compute[70645]:     </disk>
Jul 24 15:35:24 user nova-compute[70645]:     <interface type="ethernet">
Jul 24 15:35:24 user nova-compute[70645]:       <mac address="fa:16:3e:c4:80:ac"/>
Jul 24 15:35:24 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:35:24 user nova-compute[70645]:       <mtu size="1442"/>
Jul 24 15:35:24 user nova-compute[70645]:       <target dev="tape44d3e35-0b"/>
Jul 24 15:35:24 user nova-compute[70645]:     </interface>
Jul 24 15:35:24 user nova-compute[70645]:     <serial type="pty">
Jul 24 15:35:24 user nova-compute[70645]:       <log file="/opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/console.log" append="off"/>
Jul 24 15:35:24 user nova-compute[70645]:     </serial>
Jul 24 15:35:24 user nova-compute[70645]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 15:35:24 user nova-compute[70645]:     <video>
Jul 24 15:35:24 user nova-compute[70645]:       <model type="virtio"/>
Jul 24 15:35:24 user nova-compute[70645]:     </video>
Jul 24 15:35:24 user nova-compute[70645]:     <rng model="virtio">
Jul 24 15:35:24 user nova-compute[70645]:       <backend model="random">/dev/urandom</backend>
Jul 24 15:35:24 user nova-compute[70645]:     </rng>
Jul 24 15:35:24 user nova-compute[70645]:     <controller type="usb" index="0" model="none"/>
Jul 24 15:35:24 user nova-compute[70645]:     <memballoon model="virtio">
Jul 24 15:35:24 user nova-compute[70645]:       <stats period="10"/>
Jul 24 15:35:24 user nova-compute[70645]:     </memballoon>
Jul 24 15:35:24 user nova-compute[70645]:   </devices>
Jul 24 15:35:24 user nova-compute[70645]: </domain>
Jul 24 15:35:24 user nova-compute[70645]:  {{(pid=70645) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:35:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-157778356',display_name='tempest-SnapshotDataIntegrityTests-server-157778356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-157778356',id=52,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHADp0YNOOpfGvPoEP7tdnsRF9WB4vV9z9oikHGEtwvvUwthBVNBSMP7VWBouXZUVWz69y4M83a6sZI85exxU/ksGrjosyK5bCqxseBpKAcTFr9cmmW8MXQ0NEwO1I3zsQ==',key_name='tempest-keypair-212544836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8537750dd6264a7bb126d7ca45c72fb6',ramdisk_id='',reservation_id='r-e7479a90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-91902892',owner_user_name='tempest-SnapshotDataIntegrityTests-91902892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T15:35:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cdee3cff5434b20be90bd226f2c66b1',uuid=56dcec39-834d-4107-895d-29c0afe9ed86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Converting VIF {"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=e44d3e35-0b88-422d-91a8-4a1f33cb484a,network=Network(0ca60fd7-f8ac-4500-b5de-52adf14379ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3e35-0b') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG os_vif [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=e44d3e35-0b88-422d-91a8-4a1f33cb484a,network=Network(0ca60fd7-f8ac-4500-b5de-52adf14379ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3e35-0b') {{(pid=70645) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape44d3e35-0b, may_exist=True, interface_attrs={}) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape44d3e35-0b, col_values=(('external_ids', {'iface-id': 'e44d3e35-0b88-422d-91a8-4a1f33cb484a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:80:ac', 'vm-uuid': '56dcec39-834d-4107-895d-29c0afe9ed86'}),), if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:24 user nova-compute[70645]: INFO os_vif [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=e44d3e35-0b88-422d-91a8-4a1f33cb484a,network=Network(0ca60fd7-f8ac-4500-b5de-52adf14379ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3e35-0b')
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No VIF found with MAC fa:16:3e:c4:80:ac, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.network.neutron [req-bb19579c-3208-493b-bb8e-fb7552021f9a req-79f37237-0ad4-480a-a5ad-a3980981abb6 service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updated VIF entry in instance network info cache for port e44d3e35-0b88-422d-91a8-4a1f33cb484a. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG nova.network.neutron [req-bb19579c-3208-493b-bb8e-fb7552021f9a req-79f37237-0ad4-480a-a5ad-a3980981abb6 service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating instance_info_cache with network_info: [{"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:35:24 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-bb19579c-3208-493b-bb8e-fb7552021f9a req-79f37237-0ad4-480a-a5ad-a3980981abb6 service nova] Releasing lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:35:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:25 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-857cb105-a4be-4e02-bcfb-6d413df1ffbe req-b838d9f3-51d1-474a-9ba8-00c8afce7f69 service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Received event network-vif-plugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:35:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-857cb105-a4be-4e02-bcfb-6d413df1ffbe req-b838d9f3-51d1-474a-9ba8-00c8afce7f69 service nova] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:35:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-857cb105-a4be-4e02-bcfb-6d413df1ffbe req-b838d9f3-51d1-474a-9ba8-00c8afce7f69 service nova] Lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:35:25 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-857cb105-a4be-4e02-bcfb-6d413df1ffbe req-b838d9f3-51d1-474a-9ba8-00c8afce7f69 service nova] Lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:35:25 user nova-compute[70645]: DEBUG nova.compute.manager [req-857cb105-a4be-4e02-bcfb-6d413df1ffbe req-b838d9f3-51d1-474a-9ba8-00c8afce7f69 service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] No waiting events found dispatching network-vif-plugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:35:25 user nova-compute[70645]: WARNING nova.compute.manager [req-857cb105-a4be-4e02-bcfb-6d413df1ffbe req-b838d9f3-51d1-474a-9ba8-00c8afce7f69 service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Received unexpected event network-vif-plugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a for instance with vm_state building and task_state spawning.
Jul 24 15:35:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:26 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-c036bacf-6731-4a3c-b5a0-8c9c30ae418a req-c1d9eb67-bb70-48d7-b2ae-f81b55f3ad8a service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Received event network-vif-plugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c036bacf-6731-4a3c-b5a0-8c9c30ae418a req-c1d9eb67-bb70-48d7-b2ae-f81b55f3ad8a service nova] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c036bacf-6731-4a3c-b5a0-8c9c30ae418a req-c1d9eb67-bb70-48d7-b2ae-f81b55f3ad8a service nova] Lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-c036bacf-6731-4a3c-b5a0-8c9c30ae418a req-c1d9eb67-bb70-48d7-b2ae-f81b55f3ad8a service nova] Lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.compute.manager [req-c036bacf-6731-4a3c-b5a0-8c9c30ae418a req-c1d9eb67-bb70-48d7-b2ae-f81b55f3ad8a service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] No waiting events found dispatching network-vif-plugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:35:28 user nova-compute[70645]: WARNING nova.compute.manager [req-c036bacf-6731-4a3c-b5a0-8c9c30ae418a req-c1d9eb67-bb70-48d7-b2ae-f81b55f3ad8a service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Received unexpected event network-vif-plugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a for instance with vm_state building and task_state spawning.
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212928.3912525, 56dcec39-834d-4107-895d-29c0afe9ed86 => Resumed> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:35:28 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] VM Resumed (Lifecycle Event)
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Instance event wait completed in 0 seconds for  {{(pid=70645) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Guest created on hypervisor {{(pid=70645) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 15:35:28 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Instance spawned successfully.
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Found default for hw_cdrom_bus of ide {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Found default for hw_disk_bus of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Found default for hw_input_bus of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Found default for hw_pointer_model of None {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Found default for hw_video_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Found default for hw_vif_model of virtio {{(pid=70645) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 15:35:28 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.virt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Emitting event <LifecycleEvent: 1690212928.3967648, 56dcec39-834d-4107-895d-29c0afe9ed86 => Started> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:35:28 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] VM Started (Lifecycle Event)
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70645) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 15:35:28 user nova-compute[70645]: INFO nova.compute.manager [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 15:35:28 user nova-compute[70645]: INFO nova.compute.manager [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Took 8.06 seconds to spawn the instance on the hypervisor.
Jul 24 15:35:28 user nova-compute[70645]: DEBUG nova.compute.manager [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:35:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:28 user nova-compute[70645]: INFO nova.compute.manager [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Took 8.88 seconds to build instance.
Jul 24 15:35:28 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-fa4557bd-19fd-4d8f-9645-6c7ae092a354 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.013s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:35:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:35 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:48 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:35:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:35:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:52 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:35:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:35:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:35:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:55 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:35:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:35:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:35:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:35:55 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:35:56 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:35:56 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:35:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8748MB free_disk=25.273300170898438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 56dcec39-834d-4107-895d-29c0afe9ed86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:35:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:35:57 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:35:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:35:57 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:35:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:35:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:35:57 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:35:57 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:35:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating instance_info_cache with network_info: [{"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:35:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:35:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:35:58 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:35:58 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:35:58 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:35:59 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:36:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:36:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:36:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:36:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:36:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:36:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:36:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:36:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:36:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:36:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:36:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:36:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:36:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:48 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:36:48 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:36:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:36:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:36:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:36:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:52 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:36:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:36:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:36:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:55 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:36:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:36:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:36:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:36:55 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:36:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:36:56 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:36:56 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:36:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8866MB free_disk=25.272300720214844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 56dcec39-834d-4107-895d-29c0afe9ed86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:36:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:36:58 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:36:58 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:36:58 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:36:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:36:58 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:36:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:36:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:36:58 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:36:58 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:36:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:36:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:36:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:36:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:36:59 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating instance_info_cache with network_info: [{"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:36:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:36:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:37:00 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:37:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:08 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:37:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:37:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:37:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:37:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:37:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-68a6bc97-42ee-4fc8-b1d1-8bef929d6604 req-f3a0759f-196d-4392-a2cd-79d894f85b6c service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Received event network-changed-e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:37:10 user nova-compute[70645]: DEBUG nova.compute.manager [req-68a6bc97-42ee-4fc8-b1d1-8bef929d6604 req-f3a0759f-196d-4392-a2cd-79d894f85b6c service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Refreshing instance network info cache due to event network-changed-e44d3e35-0b88-422d-91a8-4a1f33cb484a. {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 15:37:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-68a6bc97-42ee-4fc8-b1d1-8bef929d6604 req-f3a0759f-196d-4392-a2cd-79d894f85b6c service nova] Acquiring lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:37:10 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-68a6bc97-42ee-4fc8-b1d1-8bef929d6604 req-f3a0759f-196d-4392-a2cd-79d894f85b6c service nova] Acquired lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:37:10 user nova-compute[70645]: DEBUG nova.network.neutron [req-68a6bc97-42ee-4fc8-b1d1-8bef929d6604 req-f3a0759f-196d-4392-a2cd-79d894f85b6c service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Refreshing network info cache for port e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 15:37:11 user nova-compute[70645]: DEBUG nova.network.neutron [req-68a6bc97-42ee-4fc8-b1d1-8bef929d6604 req-f3a0759f-196d-4392-a2cd-79d894f85b6c service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updated VIF entry in instance network info cache for port e44d3e35-0b88-422d-91a8-4a1f33cb484a. {{(pid=70645) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 15:37:11 user nova-compute[70645]: DEBUG nova.network.neutron [req-68a6bc97-42ee-4fc8-b1d1-8bef929d6604 req-f3a0759f-196d-4392-a2cd-79d894f85b6c service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating instance_info_cache with network_info: [{"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:37:11 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-68a6bc97-42ee-4fc8-b1d1-8bef929d6604 req-f3a0759f-196d-4392-a2cd-79d894f85b6c service nova] Releasing lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:37:13 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG nova.objects.instance [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:37:14 user nova-compute[70645]: INFO nova.compute.manager [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attaching volume e622e57f-8951-4888-b7dc-63704102ae36 to /dev/vdb
Jul 24 15:37:14 user nova-compute[70645]: DEBUG os_brick.utils [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a94d9af-f342-401f-9735-296394cf2b34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc20f46-f816-42ef-b273-065f4421faf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aaf203-0e01-477e-adb2-7e11cdcc2b4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9913b5-4126-4041-90b4-4b8926811905]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:37:14 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:37:14 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5634d3-e005-46c9-b082-45053304af04]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG os_brick.utils [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:37:14 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating existing volume attachment record: 0bc10bbd-05fd-4604-8789-a6b56a73c3d5 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:37:18 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AErpJjKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:37:20 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:37:20 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:37:20 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a048dcec-c93a-46c1-af44-a3d155835fd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:37:20 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae50329-b42f-4dc8-b017-0c0aefb3f583]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36] added
Jul 24 15:37:20 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30bdbe6-cf42-4aad-bbd9-ed3ccaf81665]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c2cac5-200d-4000-a606-2ce87d120aee]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AErpJjKi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AErpJjKi" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[58665c30-0ee9-40e3-9a64-ddfdefdeeddc]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AErpJjKi'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[518a4e88-daee-451a-b468-3fe969d69468]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b821bfb-ddcd-4987-9608-c61cd670c694]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:37:20 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:37:20 user nova-compute[70645]:  {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:37:20 user nova-compute[70645]: WARNING os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 15:37:20 user nova-compute[70645]: 
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[723caae7-1250-4896-998d-82afd03b8048]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36, portal: 172.16.0.220,3260]
Jul 24 15:37:20 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36, portal: 172.16.0.220,3260] successful.
Jul 24 15:37:20 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f284fded-2c33-46bf-b41f-f3d8b623b58e]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a40e19c-b192-4883-9c4d-7d92de475b72]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 (non-flash)
Jul 24 15:37:20 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 (non-flash)
Jul 24 15:37:20 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bc75f1-7010-4b6b-8a1a-f6eb214c632a]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:37:20 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AErpJjKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:37:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:37:21 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23965316666356365', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:37:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965316666356365', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:37:21 user nova-compute[70645]: DEBUG nova.objects.instance [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:37:21 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:37:21 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:37:21 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:37:21 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:37:21 user nova-compute[70645]:   <serial>e622e57f-8951-4888-b7dc-63704102ae36</serial>
Jul 24 15:37:21 user nova-compute[70645]: </disk>
Jul 24 15:37:21 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:37:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:37:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:37:22 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No VIF found with MAC fa:16:3e:c4:80:ac, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:37:22 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-68eaff0d-1bd5-4505-907c-527e06ff655f tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.017s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:37:23 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:28 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:37:36 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:37:36 user nova-compute[70645]: INFO nova.compute.manager [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Detaching volume e622e57f-8951-4888-b7dc-63704102ae36
Jul 24 15:37:36 user nova-compute[70645]: INFO nova.virt.block_device [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attempting to driver detach volume e622e57f-8951-4888-b7dc-63704102ae36 from mountpoint /dev/vdb
Jul 24 15:37:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Attempting to detach device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:37:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:37:36 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:37:36 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:37:36 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:37:36 user nova-compute[70645]:   <serial>e622e57f-8951-4888-b7dc-63704102ae36</serial>
Jul 24 15:37:36 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:37:36 user nova-compute[70645]: </disk>
Jul 24 15:37:36 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:37:36 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Successfully detached device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the persistent domain config.
Jul 24 15:37:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:37:36 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:37:36 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:37:36 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:37:36 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:37:36 user nova-compute[70645]:   <serial>e622e57f-8951-4888-b7dc-63704102ae36</serial>
Jul 24 15:37:36 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:37:36 user nova-compute[70645]: </disk>
Jul 24 15:37:36 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690213057.0921319, 56dcec39-834d-4107-895d-29c0afe9ed86 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:37:37 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Successfully detached device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the live domain config.
Jul 24 15:37:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AErpJjKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:37:37 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[08551752-3c2f-4131-ba78-48e5ab6660e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5179f3b3-e161-407c-ad52-c745e796c0a4]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 (non-flash)
Jul 24 15:37:37 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 (non-flash)
Jul 24 15:37:37 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba941a77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17e17b2-db83-4f97-bf92-4d9131696aac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a20c912-2c52-465c-abd7-39d7e8dd40c9]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[008c94e0-84a9-4afe-91cd-581046b77e28]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[439d2c2c-98f2-4881-94de-22c4f576ccfd]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f101dd80-042a-4c63-9f38-c439ad73d85c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b0888-3b2a-4769-9d18-f5312d0b17d0]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36, portal: 172.16.0.220,3260]
Jul 24 15:37:37 user nova-compute[70645]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36, portal: 172.16.0.220,3260] successful.
Jul 24 15:37:37 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e622e57f-8951-4888-b7dc-63704102ae36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[87154f6b-d02b-4448-87f3-a6f99cb2397f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.246s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== disconnect_volume: return (247ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:37:37 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:37:38 user nova-compute[70645]: DEBUG nova.objects.instance [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:37:38 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-eb3caae7-ecc1-4100-9a03-bedb0edd7275 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.556s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:37:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:37:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:37:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:37:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:37:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:37:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:37:49 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:37:49 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:37:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:37:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:37:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:37:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:37:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:37:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:37:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:37:55 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:37:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:37:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:37:55 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:37:55 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:37:55 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:37:56 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:37:56 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:37:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.270980834960938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 56dcec39-834d-4107-895d-29c0afe9ed86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:37:56 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:37:59 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:38:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating instance_info_cache with network_info: [{"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:38:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:38:00 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:38:00 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:38:02 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:38:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:38:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:38:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:38:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:38:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:38:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:38:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:38:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:38:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:38:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:38:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:38:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:38:29 user nova-compute[70645]: INFO nova.compute.manager [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attaching volume b8b507e9-6134-4c7a-8db9-90bd660fc61e to /dev/vdb
Jul 24 15:38:29 user nova-compute[70645]: DEBUG os_brick.utils [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1807286c-32fb-417a-a56a-3f063eec415a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22c08fe-38aa-4b47-b24e-2ed124826718]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf71454-2bfa-4990-9cdd-67a97644009e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[55363671-29d7-4b93-8d5d-7965e1312208]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:38:29 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:38:29 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad0fd34-bec0-4baf-9e29-d443502bdc1c]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG os_brick.utils [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:38:29 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating existing volume attachment record: 3fd4fb21-c0ab-40ce-a98a-afc39e9a615f {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:38:33 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kvxPzwKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:38:39 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:38:39 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:38:39 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0fa13c-4ea5-481d-b621-86c60aa007f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:38:39 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[833b1e40-0722-4ffb-951d-675259a599c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e] added
Jul 24 15:38:39 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7fcc93-0d27-4edf-add9-203ee84d09e2]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[38942161-2ba6-4f70-b5c2-27c49a6b75be]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kvxPzwKl {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kvxPzwKl" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dfed30-02dd-4146-9418-7bc8ec5af56c]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kvxPzwKl'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5d8cec-32b7-43e7-a271-4e43fff95dd7]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9cad42-38e2-481d-bdf3-336a4c02c4cd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:38:39 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:38:39 user nova-compute[70645]:  {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:38:39 user nova-compute[70645]: WARNING os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 15:38:39 user nova-compute[70645]: 
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b269b829-8d9c-40d9-b598-19767a8a87aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e, portal: 172.16.0.220,3260]
Jul 24 15:38:39 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e, portal: 172.16.0.220,3260] successful.
Jul 24 15:38:39 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2660b1-2927-4ae5-9b8f-d27323a23b72]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbac1ca2-e513-4c87-939a-9902457b19b1]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e (non-flash)
Jul 24 15:38:39 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e (non-flash)
Jul 24 15:38:39 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc21e8c-6dd2-4074-92d9-7a3aebb3e1d2]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:38:39 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kvxPzwKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:38:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:38:40 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23865383136623365', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:38:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865383136623365', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:38:40 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:38:40 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:38:40 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:38:40 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:38:40 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:38:40 user nova-compute[70645]:   <serial>b8b507e9-6134-4c7a-8db9-90bd660fc61e</serial>
Jul 24 15:38:40 user nova-compute[70645]: </disk>
Jul 24 15:38:40 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:38:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:38:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:38:41 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No VIF found with MAC fa:16:3e:c4:80:ac, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:38:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f5bb7417-57c9-4202-a3ff-4b8e69d1d58a tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.691s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:38:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:38:44 user nova-compute[70645]: INFO nova.compute.manager [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Detaching volume b8b507e9-6134-4c7a-8db9-90bd660fc61e
Jul 24 15:38:44 user nova-compute[70645]: INFO nova.virt.block_device [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attempting to driver detach volume b8b507e9-6134-4c7a-8db9-90bd660fc61e from mountpoint /dev/vdb
Jul 24 15:38:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Attempting to detach device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:38:44 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:38:44 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:38:44 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:38:44 user nova-compute[70645]:   <serial>b8b507e9-6134-4c7a-8db9-90bd660fc61e</serial>
Jul 24 15:38:44 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:38:44 user nova-compute[70645]: </disk>
Jul 24 15:38:44 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:38:44 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Successfully detached device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the persistent domain config.
Jul 24 15:38:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:38:44 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:38:44 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:38:44 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:38:44 user nova-compute[70645]:   <serial>b8b507e9-6134-4c7a-8db9-90bd660fc61e</serial>
Jul 24 15:38:44 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:38:44 user nova-compute[70645]: </disk>
Jul 24 15:38:44 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690213124.753084, 56dcec39-834d-4107-895d-29c0afe9ed86 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:38:44 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Successfully detached device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the live domain config.
Jul 24 15:38:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kvxPzwKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:38:44 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfc9de1-40a2-460e-8c98-02378c4d14d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[45432da0-2862-416c-9549-14a9376c699c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e (non-flash)
Jul 24 15:38:44 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e (non-flash)
Jul 24 15:38:44 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba84297880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[00559cc3-69ea-4c19-b832-e98ebbef8697]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[de548024-a228-427e-bc93-9aa5c261f761]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f843303-b871-4b38-b0d0-bbfc4dd3b8f3]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fd63ae-7fd4-433e-94fb-de9248854f39]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74c1d84-90b1-4715-98c3-6bde37890cee]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:38:44 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[312d9034-6eb4-48a7-88e7-ce136f0b2889]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e, portal: 172.16.0.220,3260]
Jul 24 15:38:45 user nova-compute[70645]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e, portal: 172.16.0.220,3260] successful.
Jul 24 15:38:45 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b507e9-6134-4c7a-8db9-90bd660fc61e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7107fc2f-086c-4cfc-8f7d-0e4062e9b443]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== disconnect_volume: return (299ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG nova.objects.instance [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:38:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-49eb9fcf-cade-4b6e-903d-fb511c1072bc tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.668s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:38:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:50 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:38:50 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:38:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:38:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:38:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:38:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:38:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:38:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:38:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:38:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:38:56 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:38:57 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:38:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:38:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:38:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:38:57 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:38:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:38:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:38:58 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8841MB free_disk=25.269927978515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 56dcec39-834d-4107-895d-29c0afe9ed86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:38:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:38:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:00 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:00 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:39:00 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:39:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:39:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:39:00 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:39:00 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:39:01 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating instance_info_cache with network_info: [{"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:39:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:39:01 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:39:01 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:01 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:03 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:39:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:39:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:39:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:39:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:12 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:12 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 15:39:12 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] There are 0 instances to clean {{(pid=70645) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 15:39:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:39:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:39:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:39:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:39:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:39:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:39:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:39:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:39:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:21 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:39:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:39:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:39:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:39:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:39:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:39:36 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:36 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70645) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG nova.objects.instance [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:39:37 user nova-compute[70645]: INFO nova.compute.manager [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attaching volume 6336000d-c23a-4ac7-849d-8737296fa404 to /dev/vdb
Jul 24 15:39:37 user nova-compute[70645]: DEBUG os_brick.utils [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5f7349-820d-492e-8883-439722f451ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a1f3cd-5723-49ee-b123-796b2d46a44d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d250e69-9063-4808-8040-ee35a5f9c3e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[db70701d-cff3-4b1f-bbaf-782f8e8878be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:39:37 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:39:37 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5b6b86-ac8b-452e-9450-1b18b13921c3]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG os_brick.utils [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:39:37 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating existing volume attachment record: d995dcf7-a070-458a-8d83-5c16bf7e212a {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:39:38 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPLMQmcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:39:43 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:39:43 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:39:43 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acb093d-115c-4420-bc22-0064ccad9604]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:39:43 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5638cd8a-5d2c-4b02-b198-df145bfd8896]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404] added
Jul 24 15:39:43 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[927741b4-0df6-470e-b308-99d4ca5a39d0]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bd51ca-ef86-458b-afa0-64574473673d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPLMQmcC {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPLMQmcC" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4843c8a-cbf2-4ada-8b76-283dc4a6c45b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nPLMQmcC'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cf6325-8e89-4ae7-919c-6aa05763406f]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf16fbf7-b1e5-49ae-89b0-a90ba2fe4309]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:39:43 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:39:43 user nova-compute[70645]:  {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:39:43 user nova-compute[70645]: WARNING os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 15:39:43 user nova-compute[70645]: 
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d6d836-bfa7-4f11-a5df-a229124d7436]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404, portal: 172.16.0.220,3260]
Jul 24 15:39:43 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404, portal: 172.16.0.220,3260] successful.
Jul 24 15:39:43 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ad4b4a-4d73-4764-9636-731e27835463]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82fabf7-39b2-4aed-ab7b-8be3f5a2940f]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 (non-flash)
Jul 24 15:39:43 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 (non-flash)
Jul 24 15:39:43 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b067af8-d649-46b9-9ae0-4301c005456e]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:39:43 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPLMQmcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:39:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:39:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:39:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:39:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:39:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:39:44 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23738656265343666', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:39:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738656265343666', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:39:44 user nova-compute[70645]: DEBUG nova.objects.instance [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:39:44 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:39:44 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:39:44 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:39:44 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:39:44 user nova-compute[70645]:   <serial>6336000d-c23a-4ac7-849d-8737296fa404</serial>
Jul 24 15:39:44 user nova-compute[70645]: </disk>
Jul 24 15:39:44 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:39:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:39:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:39:45 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No VIF found with MAC fa:16:3e:c4:80:ac, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:39:45 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-97bd1b6b-450c-4278-b174-65f357124060 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.017s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:39:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:39:47 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:39:47 user nova-compute[70645]: INFO nova.compute.manager [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Detaching volume 6336000d-c23a-4ac7-849d-8737296fa404
Jul 24 15:39:47 user nova-compute[70645]: INFO nova.virt.block_device [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attempting to driver detach volume 6336000d-c23a-4ac7-849d-8737296fa404 from mountpoint /dev/vdb
Jul 24 15:39:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Attempting to detach device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:39:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:39:47 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:39:47 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:39:47 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:39:47 user nova-compute[70645]:   <serial>6336000d-c23a-4ac7-849d-8737296fa404</serial>
Jul 24 15:39:47 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:39:47 user nova-compute[70645]: </disk>
Jul 24 15:39:47 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:39:47 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Successfully detached device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the persistent domain config.
Jul 24 15:39:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:39:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:39:47 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:39:47 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:39:47 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:39:47 user nova-compute[70645]:   <serial>6336000d-c23a-4ac7-849d-8737296fa404</serial>
Jul 24 15:39:47 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:39:47 user nova-compute[70645]: </disk>
Jul 24 15:39:47 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690213188.330472, 56dcec39-834d-4107-895d-29c0afe9ed86 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:39:48 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Successfully detached device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the live domain config.
Jul 24 15:39:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPLMQmcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:39:48 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[76372c8e-af8c-463d-aa97-a37a460c7195]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff11927-8dd2-4adf-ae48-116ea597350f]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 (non-flash)
Jul 24 15:39:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 (non-flash)
Jul 24 15:39:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba846788b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bcca51-a2a0-45ac-a73e-3e63d2d8a96d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2233ad3e-5c09-4a8d-aba2-0354a2f5f24d]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[953d5a17-9d33-4007-a236-b0d118c75a44]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c0062f-4640-4387-b5de-6cb27ae222ba]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[922d0e6f-a245-4277-a63a-d4728c1463b4]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[533db6e0-e5a0-4dcd-b5be-34c452da7dba]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404, portal: 172.16.0.220,3260]
Jul 24 15:39:48 user nova-compute[70645]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404, portal: 172.16.0.220,3260] successful.
Jul 24 15:39:48 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336000d-c23a-4ac7-849d-8737296fa404 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[072d65d3-3b80-48da-b428-1b3f50b9746d]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== disconnect_volume: return (272ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:39:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:39:49 user nova-compute[70645]: DEBUG nova.objects.instance [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:39:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-571eff44-b88f-47d5-9574-b367750636c3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.599s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:39:51 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:51 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:39:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Triggering sync for uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 15:39:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:39:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:39:54 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:39:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:39:55 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:56 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:57 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:57 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:39:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:39:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:39:57 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:39:57 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:39:57 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:39:58 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:39:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:39:58 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:39:58 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8847MB free_disk=25.26891326904297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:39:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:39:58 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:39:58 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 56dcec39-834d-4107-895d-29c0afe9ed86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:39:58 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:39:58 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:39:59 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing inventories for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 15:39:59 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Updating ProviderTree inventory for provider a0cf5b80-69d2-4191-894e-a498eab7d688 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 15:39:59 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Updating inventory in ProviderTree for provider a0cf5b80-69d2-4191-894e-a498eab7d688 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 15:39:59 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing aggregate associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, aggregates: None {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 15:39:59 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Refreshing trait associations for resource provider a0cf5b80-69d2-4191-894e-a498eab7d688, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE {{(pid=70645) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 15:39:59 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:39:59 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:39:59 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:39:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:39:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:02 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:40:02 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:40:02 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:40:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:40:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:40:02 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:40:02 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:40:02 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating instance_info_cache with network_info: [{"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:40:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:40:02 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:40:02 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:40:03 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:40:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:04 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:40:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:40:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:40:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:40:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:40:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:40:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:40:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:40:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:40:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:40:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:40:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:40:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:40:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:40:41 user nova-compute[70645]: INFO nova.compute.manager [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attaching volume 0df642c6-bff3-466e-ac1d-8a20c4fe691e to /dev/vdb
Jul 24 15:40:41 user nova-compute[70645]: DEBUG os_brick.utils [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[975ac877-a6b3-44c6-8bfe-b7c1c38da0bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b2e794ff8af3\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4e2ee5-c543-4af6-bd45-2de1b8537246]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[340f9a72-43f4-45f5-acb5-41cc56ad461f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbe3cf2-084c-4279-9bed-b05a3c34690a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Running cmd (subprocess): nvme version {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] 'nvme version' failed. Not Retrying. {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] nvme not present on system {{(pid=70645) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 15:40:41 user nova-compute[70645]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 15:40:41 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fc0f0f-dad3-46f7-9f46-6432dc7e89f8]: (4, '') {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70645) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] LIGHTOS: no hostnqn found. {{(pid=70645) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG os_brick.utils [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b2e794ff8af3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:40:41 user nova-compute[70645]: DEBUG nova.virt.block_device [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating existing volume attachment record: cd4525b6-721f-40e9-ad91-40d52d322e25 {{(pid=70645) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 15:40:43 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Calling os-brick to attach iSCSI Volume {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzHcnKsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:40:47 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:40:47 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:40:47 user nova-compute[70645]: INFO os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[64242ab2-267a-4214-a7bf-b873101fdf79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 15:40:47 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --interface default --op new {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[035d173d-1b2b-4b9c-985d-a541b7bbbe3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e] added\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e] added
Jul 24 15:40:47 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c382d29-c9b2-4bc8-8205-bb977a96d6da]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c226d7-8945-48d6-8780-67d20f1b57b9]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wzHcnKsi {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wzHcnKsi" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c778b82f-131c-4a7f-9583-5b222533d12b]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wzHcnKsi'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a0ee20-a39d-443e-92e9-4221a0df5493]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb2723b-8dd6-49fa-80c3-840dd86f8a6e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:40:47 user nova-compute[70645]:  {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 15:40:47 user nova-compute[70645]:  {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:40:47 user nova-compute[70645]: WARNING os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 15:40:47 user nova-compute[70645]: 
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --login {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7739ea5b-b6c8-4df2-9f3d-fcd23817a7e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e, portal: 172.16.0.220,3260]
Jul 24 15:40:47 user nova-compute[70645]: Login to [iface: default, target: iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e, portal: 172.16.0.220,3260] successful.
Jul 24 15:40:47 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f1cc9-f8e4-4f69-8b8d-2fbcf07d99c8]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[484c55e7-ad59-4f1c-8d82-52799eb76af9]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e (non-flash)
Jul 24 15:40:47 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e (non-flash)
Jul 24 15:40:47 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Connected to 172.16.0.220:3260 {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=70645) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70645) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7181e0-3886-47be-a192-515efd2a15a6]: (4, ('- - 0', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70645) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 15:40:47 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzHcnKsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70645) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 15:40:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:40:48 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23938383364386335', 'path': '/dev/sdb'} {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:40:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938383364386335', 'path': '/dev/sdb'} {{(pid=70645) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 15:40:48 user nova-compute[70645]: DEBUG nova.objects.instance [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:40:48 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 15:40:48 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:40:48 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:40:48 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:40:48 user nova-compute[70645]:   <serial>0df642c6-bff3-466e-ac1d-8a20c4fe691e</serial>
Jul 24 15:40:48 user nova-compute[70645]: </disk>
Jul 24 15:40:48 user nova-compute[70645]:  {{(pid=70645) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 15:40:48 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No BDM found with device name vda, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:40:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70645) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 15:40:49 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] No VIF found with MAC fa:16:3e:c4:80:ac, not building metadata {{(pid=70645) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 15:40:49 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-c8e8d95d-bc24-4995-963c-bbfaf8e73815 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.894s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:40:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:40:51 user nova-compute[70645]: INFO nova.compute.manager [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Detaching volume 0df642c6-bff3-466e-ac1d-8a20c4fe691e
Jul 24 15:40:51 user nova-compute[70645]: INFO nova.virt.block_device [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Attempting to driver detach volume 0df642c6-bff3-466e-ac1d-8a20c4fe691e from mountpoint /dev/vdb
Jul 24 15:40:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Attempting to detach device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the persistent domain config. {{(pid=70645) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:40:51 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:40:51 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:40:51 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:40:51 user nova-compute[70645]:   <serial>0df642c6-bff3-466e-ac1d-8a20c4fe691e</serial>
Jul 24 15:40:51 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:40:51 user nova-compute[70645]: </disk>
Jul 24 15:40:51 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:40:51 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Successfully detached device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the persistent domain config.
Jul 24 15:40:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the live domain config. {{(pid=70645) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.guest [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 15:40:51 user nova-compute[70645]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 15:40:51 user nova-compute[70645]:   <source dev="/dev/sdb"/>
Jul 24 15:40:51 user nova-compute[70645]:   <target dev="vdb" bus="virtio"/>
Jul 24 15:40:51 user nova-compute[70645]:   <serial>0df642c6-bff3-466e-ac1d-8a20c4fe691e</serial>
Jul 24 15:40:51 user nova-compute[70645]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 15:40:51 user nova-compute[70645]: </disk>
Jul 24 15:40:51 user nova-compute[70645]:  {{(pid=70645) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-4c2d8732-596d-4660-9fca-02fb7b379b91 None None] Received event <DeviceRemovedEvent: 1690213251.9051895, 56dcec39-834d-4107-895d-29c0afe9ed86 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70645) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.driver [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 15:40:51 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Successfully detached device vdb from instance 56dcec39-834d-4107-895d-29c0afe9ed86 from the live domain config.
Jul 24 15:40:51 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] calling os-brick to detach iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba94164640>, {'target_iqns': ['iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzHcnKsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 15:40:51 user nova-compute[70645]: WARNING os_brick.initiator.connectors.base [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 15:40:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e', 0)] {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3b83ed-ec57-4bdb-8879-791e56490713]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f67f6eb-216b-46cf-9aec-d873589c8c59]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e (non-flash)\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e (non-flash)
Jul 24 15:40:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e (non-flash)
Jul 24 15:40:51 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba942b2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e'): ({'sdb'}, set())}) {{(pid=70645) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Removing single pathed devices sdb {{(pid=70645) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:51 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf2c9bf-b4cd-4ebe-af04-33585b7f7223]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[775f798f-0fe2-45b4-a066-0307002a174b]: (4, ('ok\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Flushing IO for device /dev/sdb {{(pid=70645) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fffb1b5-acb0-4c2f-bc5d-7401f7426ee7]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70645) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c6c155-83aa-4ae0-a0c7-ad4ec1aeaf55]: (4, ('1', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG os_brick.initiator.linuxscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] SCSI volumes sdb have been removed. {{(pid=70645) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e')] {{(pid=70645) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[901d8399-48e9-414d-aff6-1941877ad7d1]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --logout {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d72db0-68e7-456d-8e33-4414136ed1e8]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e, portal: 172.16.0.220,3260]
Jul 24 15:40:52 user nova-compute[70645]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e, portal: 172.16.0.220,3260] successful.
Jul 24 15:40:52 user nova-compute[70645]:  stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op delete {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df642c6-bff3-466e-ac1d-8a20c4fe691e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf14d19-8ebd-4812-81c6-c1a06d4a97ea]: (4, ('', '')) {{(pid=81509) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70645) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.base [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] <== disconnect_volume: return (298ms) None {{(pid=70645) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Disconnected iSCSI Volume {{(pid=70645) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:40:52 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:40:53 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'flavor' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:40:53 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9ee02abc-d2d3-4f4c-988e-7a9372512d9e tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.691s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:40:53 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:55 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:40:58 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:40:59 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:41:00 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:41:00 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:41:00 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8840MB free_disk=25.267940521240234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 56dcec39-834d-4107-895d-29c0afe9ed86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:41:00 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:41:03 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:41:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:41:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:41:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 15:41:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquired lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 15:41:04 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Forcefully refreshing network info cache for instance {{(pid=70645) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 15:41:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lazy-loading 'info_cache' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:41:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:41:04 user nova-compute[70645]: DEBUG nova.network.neutron [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating instance_info_cache with network_info: [{"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:41:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Releasing lock "refresh_cache-56dcec39-834d-4107-895d-29c0afe9ed86" {{(pid=70645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 15:41:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updated the network info_cache for instance {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 15:41:04 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:41:04 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:41:06 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:41:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:41:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:41:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:41:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:41:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:41:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:41:10 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:41:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:41:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:41:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:41:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:41:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:41:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:41:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:41:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:41:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:41:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:41:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:41:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:41:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:41:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:41:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:41:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:41:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:41:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:41:53 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:41:53 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:41:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:41:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:41:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:41:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:41:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:41:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:41:55 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:41:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:41:59 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:42:00 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:42:01 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:42:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:42:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:42:01 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:42:01 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:42:01 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG oslo_concurrency.processutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70645) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 15:42:02 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:42:02 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:42:02 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8866MB free_disk=25.259227752685547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Instance 56dcec39-834d-4107-895d-29c0afe9ed86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70645) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:42:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:42:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:42:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:42:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:42:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:42:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:42:03 user nova-compute[70645]: INFO nova.compute.manager [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Terminating instance
Jul 24 15:42:03 user nova-compute[70645]: DEBUG nova.compute.manager [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Start destroying the instance on the hypervisor. {{(pid=70645) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 15:42:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:03 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-06d0a16e-209f-4027-8a1e-926e0e8cf9fc req-e3309623-e195-483d-9406-388b782315ca service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Received event network-vif-unplugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-06d0a16e-209f-4027-8a1e-926e0e8cf9fc req-e3309623-e195-483d-9406-388b782315ca service nova] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-06d0a16e-209f-4027-8a1e-926e0e8cf9fc req-e3309623-e195-483d-9406-388b782315ca service nova] Lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-06d0a16e-209f-4027-8a1e-926e0e8cf9fc req-e3309623-e195-483d-9406-388b782315ca service nova] Lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-06d0a16e-209f-4027-8a1e-926e0e8cf9fc req-e3309623-e195-483d-9406-388b782315ca service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] No waiting events found dispatching network-vif-unplugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.compute.manager [req-06d0a16e-209f-4027-8a1e-926e0e8cf9fc req-e3309623-e195-483d-9406-388b782315ca service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Received event network-vif-unplugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a for instance with task_state deleting. {{(pid=70645) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [-] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Instance destroyed successfully.
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.objects.instance [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lazy-loading 'resources' on Instance uuid 56dcec39-834d-4107-895d-29c0afe9ed86 {{(pid=70645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.virt.libvirt.vif [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T15:35:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-157778356',display_name='tempest-SnapshotDataIntegrityTests-server-157778356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-157778356',id=52,image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHADp0YNOOpfGvPoEP7tdnsRF9WB4vV9z9oikHGEtwvvUwthBVNBSMP7VWBouXZUVWz69y4M83a6sZI85exxU/ksGrjosyK5bCqxseBpKAcTFr9cmmW8MXQ0NEwO1I3zsQ==',key_name='tempest-keypair-212544836',keypairs=<?>,launch_index=0,launched_at=2023-07-24T15:35:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8537750dd6264a7bb126d7ca45c72fb6',ramdisk_id='',reservation_id='r-e7479a90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4bccd44-68c1-4fe3-8a56-c3963153c7de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-91902892',owner_user_name='tempest-SnapshotDataIntegrityTests-91902892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T15:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cdee3cff5434b20be90bd226f2c66b1',uuid=56dcec39-834d-4107-895d-29c0afe9ed86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Converting VIF {"id": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "address": "fa:16:3e:c4:80:ac", "network": {"id": "0ca60fd7-f8ac-4500-b5de-52adf14379ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1527608290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8537750dd6264a7bb126d7ca45c72fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3e35-0b", "ovs_interfaceid": "e44d3e35-0b88-422d-91a8-4a1f33cb484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.network.os_vif_util [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=e44d3e35-0b88-422d-91a8-4a1f33cb484a,network=Network(0ca60fd7-f8ac-4500-b5de-52adf14379ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3e35-0b') {{(pid=70645) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG os_vif [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=e44d3e35-0b88-422d-91a8-4a1f33cb484a,network=Network(0ca60fd7-f8ac-4500-b5de-52adf14379ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3e35-0b') {{(pid=70645) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape44d3e35-0b, bridge=br-int, if_exists=True) {{(pid=70645) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:42:04 user nova-compute[70645]: INFO os_vif [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=e44d3e35-0b88-422d-91a8-4a1f33cb484a,network=Network(0ca60fd7-f8ac-4500-b5de-52adf14379ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3e35-0b')
Jul 24 15:42:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Deleting instance files /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86_del
Jul 24 15:42:04 user nova-compute[70645]: INFO nova.virt.libvirt.driver [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Deletion of /opt/stack/data/nova/instances/56dcec39-834d-4107-895d-29c0afe9ed86_del complete
Jul 24 15:42:04 user nova-compute[70645]: INFO nova.compute.manager [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 24 15:42:04 user nova-compute[70645]: DEBUG oslo.service.loopingcall [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70645) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.compute.manager [-] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Deallocating network for instance {{(pid=70645) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] deallocate_for_instance() {{(pid=70645) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Skipping network cache update for instance because it is being deleted. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9839}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 15:42:04 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:42:05 user nova-compute[70645]: DEBUG nova.network.neutron [-] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Updating instance_info_cache with network_info: [] {{(pid=70645) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 15:42:05 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Took 1.07 seconds to deallocate network for instance.
Jul 24 15:42:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:42:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:42:05 user nova-compute[70645]: DEBUG nova.compute.manager [req-c46a8d29-f33a-4ed8-b3f4-c800067a9730 req-386ecb3c-eabb-451b-bf4c-e7ba62a2b182 service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Received event network-vif-deleted-e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:42:05 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:42:05 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:42:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:42:05 user nova-compute[70645]: INFO nova.scheduler.client.report [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Deleted allocations for instance 56dcec39-834d-4107-895d-29c0afe9ed86
Jul 24 15:42:05 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-f302b859-fb24-46f3-bee3-1a2f698d35f3 tempest-SnapshotDataIntegrityTests-91902892 tempest-SnapshotDataIntegrityTests-91902892-project-member] Lock "56dcec39-834d-4107-895d-29c0afe9ed86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.232s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:42:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-b94316f8-37ca-4e68-b4c3-059d13fd9d5f req-a0c9fded-42ba-42c3-b1ba-efaa2b4025fd service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Received event network-vif-plugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 15:42:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b94316f8-37ca-4e68-b4c3-059d13fd9d5f req-a0c9fded-42ba-42c3-b1ba-efaa2b4025fd service nova] Acquiring lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:42:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b94316f8-37ca-4e68-b4c3-059d13fd9d5f req-a0c9fded-42ba-42c3-b1ba-efaa2b4025fd service nova] Lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:42:06 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [req-b94316f8-37ca-4e68-b4c3-059d13fd9d5f req-a0c9fded-42ba-42c3-b1ba-efaa2b4025fd service nova] Lock "56dcec39-834d-4107-895d-29c0afe9ed86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:42:06 user nova-compute[70645]: DEBUG nova.compute.manager [req-b94316f8-37ca-4e68-b4c3-059d13fd9d5f req-a0c9fded-42ba-42c3-b1ba-efaa2b4025fd service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] No waiting events found dispatching network-vif-plugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a {{(pid=70645) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 15:42:06 user nova-compute[70645]: WARNING nova.compute.manager [req-b94316f8-37ca-4e68-b4c3-059d13fd9d5f req-a0c9fded-42ba-42c3-b1ba-efaa2b4025fd service nova] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Received unexpected event network-vif-plugged-e44d3e35-0b88-422d-91a8-4a1f33cb484a for instance with vm_state deleted and task_state None.
Jul 24 15:42:07 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:42:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:42:19 user nova-compute[70645]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690213324.4060996, 56dcec39-834d-4107-895d-29c0afe9ed86 => Stopped> {{(pid=70645) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 15:42:19 user nova-compute[70645]: INFO nova.compute.manager [-] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] VM Stopped (Lifecycle Event)
Jul 24 15:42:19 user nova-compute[70645]: DEBUG nova.compute.manager [None req-5ed007d9-328e-4182-ba5d-0607adcb2a90 None None] [instance: 56dcec39-834d-4107-895d-29c0afe9ed86] Checking state {{(pid=70645) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 15:42:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:42:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:42:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:42:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:42:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:24 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:42:29 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:42:34 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:42:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:42:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70645) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 15:42:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:42:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70645) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 15:42:39 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:44 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:49 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:42:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:54 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:54 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:42:54 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70645) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 15:42:55 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:42:57 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:59 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:42:59 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:43:00 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:43:01 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:43:02 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:43:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:43:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:43:02 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:43:02 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Auditing locally available compute resources for user (node: user) {{(pid=70645) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 15:43:03 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:43:03 user nova-compute[70645]: WARNING nova.virt.libvirt.driver [None req-9a4079be-735c-4675-8534-29974778ad02 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 15:43:03 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.285858154296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=70645) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 15:43:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 15:43:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 15:43:03 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 15:43:03 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70645) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 15:43:03 user nova-compute[70645]: DEBUG nova.compute.provider_tree [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed in ProviderTree for provider: a0cf5b80-69d2-4191-894e-a498eab7d688 {{(pid=70645) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 15:43:03 user nova-compute[70645]: DEBUG nova.scheduler.client.report [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Inventory has not changed for provider a0cf5b80-69d2-4191-894e-a498eab7d688 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70645) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 15:43:03 user nova-compute[70645]: DEBUG nova.compute.resource_tracker [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Compute_service record updated for user:user {{(pid=70645) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 15:43:03 user nova-compute[70645]: DEBUG oslo_concurrency.lockutils [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=70645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 15:43:04 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:43:05 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:43:05 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Starting heal instance info cache {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 15:43:05 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Rebuilding the list of instances to heal {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 15:43:05 user nova-compute[70645]: DEBUG nova.compute.manager [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Didn't find any instances for network info cache update. {{(pid=70645) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 15:43:05 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:43:05 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:43:09 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 15:43:09 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:43:14 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 15:43:15 user nova-compute[70645]: DEBUG oslo_service.periodic_task [None req-9a4079be-735c-4675-8534-29974778ad02 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70645) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 15:43:19 user nova-compute[70645]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70645) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}